His father, Colonel James Tallmadge (1744–1821), led a company of volunteers at the capture of General John Burgoyne.

It read as follows: And provided, That the further introduction of slavery or involuntary servitude be prohibited, except for the punishment of crimes, whereof the party shall have been fully convicted; and that all children born within the said State, after the admission thereof into the Union, shall be free at the age of twenty-five years.

[1] In 1836, he visited Russia, and helped introduce into that country several American mechanical inventions, especially cotton-spinning machinery.

His first cousin was United States Senator and Wisconsin Territorial Governor Nathaniel P. Tallmadge.

His first cousin, once removed was Benjamin Tallmadge, United States Congressman from Connecticut and spy for George Washington during the American Revolutionary War.

He was also one of the founders of the American Institute, a New York society for the promotion of inventions and technical education, and was its president from 1831 to 1850.

His only surviving grandchild, James Tallmadge Van Rensselaer, was a well-known lawyer in New York City.