He was the youngest son of Mary Jellett Duff (1838 – c.1885) and Francis Shubael Smith I (1819–1887).
Francis partnered with Francis Scott Street and started the publishing firm of Street & Smith.
Ormond had the following siblings: Francis Shubael Smith II (1854–?
He graduated from Harvard University in 1883[1], and joined his father at Street & Smith after graduation.
On December 25, 1899 Ormond married Grace Hewitt Pellett and they had one child: Gerald Hewitt Smith who attended Princeton University.