On his mother's side, he was descended from Thomas Hastings, who came from the East Anglian area of England to the Massachusetts Bay Colony in 1634.

The couple sailed to Hawaii (then known as the 'Sandwich Islands') that same year, on the ship Parthian, the third company from the American Board of Commissioners for Foreign Missions.

[1] He was assigned to the mission at Honolulu on the island of Oahu, as a missionary physician, and continued in that employment fifteen years.

In 1850 Judd purchased from King Kamehameha the land which became the Kualoa Ranch on the Windward Coast of Oahu.

[10] His papers were kept under restricted access at the Bishop Museum until his great-grandson Albert Francis Judd III died in 2006.