Their parents were Sam (Sholem) (née Chernofski) Schwartz, born circa June 1866, and Lena (Liba Chasia) Krakofsky, born circa March 1871, who were Jewish immigrants originally from the Mala Berezianka, Kivshovata, Tarascha, and Belaya Tserkov (Bila Tserkva) area, south of Kiev in Kiev oblast, Ukraine, who had immigrated to the United States between 1891 and 1895.
When they were young, elder brothers Henry and Irving went door-to-door in Brooklyn carrying around sacks of coal on their backs, peddling it to the nearby homes and residential buildings to earn extra money for their family.
They eventually won a major contract with New York City in the early 1930s to supply fuel oil to several city-run buildings.
The company operated a large fleet of fuel delivery trucks around the Northeastern United States, and eventually had several oil tankers.
These included the Metropolitan Opera at then-newly built Lincoln Center, several buildings and lecture programs at New York University, several New York City and Long Island hospitals including Mount Sinai Hospital, Fifth Avenue Synagogue, the Maimonides Foundation for Gifted Youth, and at least three graduate schools.
Thus, despite his Orthodox Jewish background, he also donated heavily to many Catholic charities and organizations, including endowing The Caroline Di Donato Schwartz building at Seton Hall, which was completed in 1973.
After the purges in the early 1890s, one part of the family decided to go to America, while others stayed behind in Russia to continue the exporting of Whale Oil.
The family traveled to London, England during the early part of 1895 to strengthen contacts they had previously made with the Royal Court of Queen Victoria that would serve them later with Paragon Oil.
He was nonagenarian Jack Lawrence (née Jacob Schwartz), a well-known songwriter and former president of ASCAP, and the son of Sam's youngest sibling Barney.