[2] After leaving the bank, he joined the lumber firm of Bissell, Fassett & Co.[4] In 1866, he relocated to New York City and became a stockbroker in Wall Street.

[2] On January 1, 1877, he was appointed New York State Comptroller to serve for the remainder of the unexpired term of Lucius Robinson who had been elected Governor.

[8] Together, they had two children, a son and a daughter:[4] After suffering from heart trouble and chronic Bright's disease, he died at his farm in Bernardsville, New Jersey.

Through his son Dudley, he was a grandfather of Jeanne "Jean" Grubb Olcott, who married George M. Owens,[24] and Gladys Grubb Olcott (1904–1978), who married French soldier and diplomat, Jean de Pendril Waddington, in 1922.

[25] They divorced in 1932,[26] and she married Count Josef Graf von Ledebur-Wicheln a month later.