Latham was born around 1835 in Yates County, New York, to Lewis A. Birdsall and Mary Jane Lee.

Sophie was a favorite of Sacramento and San Francisco society, and was known by the soubriquet the "Belle of the Prairie."

Milton was governor for five days before he was elected to the United States Senate, filling the vacancy created by David Broderick's death.

Latham died 10 September 1867 and was buried at the Laurel Hill Cemetery in San Francisco.

Both Sophie and Milton were moved to the Cypress Lawn Memorial Park in Colma around 1940, when the cemetery was closed due to an ordinance prohibiting graveyards within city limits.