Upon retiring as a marble-cutter in 1890, he began to sketch, from memory, scenes of 19th-century Portland, Maine, his hometown.

His book, Portland Through Grandfather's Eyes, is now in the possession of the Maine Historical Society.

[4] When he retired, in 1890, he began to sketch, from memory or printed materials,[5] several scenes of Portland in the 1840s.

[6] He put together a book, Portland Through Grandfather's Eyes, which was recreated in 1981 by the Maine Historical Society as Mr. Goodhue Remembers Portland: Scenes from the Mid-19th Century,[7][8] containing 23 of Goodhue's drawings and one by his great-granddaughter.

[9][10] In 1858, Goodhue married Catherine O'Donnell, with whom he had six known children between 1859 and 1878, including Henrietta Quincy.