Bory received his degree in building engineering in Budapest in 1903.
He enrolled in the Academy of Fine Arts to study sculpture under Alajos Stróbl.
At this time he met his wife, Ilona Komocsin (1885-1974), who became a notable painter after finishing her studies in Szeged.
He was largely responsible for the building of the so-called Bory castle in Székesfehérvár which is decorated by his and his wife's works.
He built this fantastic, castle-like structure out of concrete with his own hands for 41 years.