Being the only son that left descendants, Peter inherited the 60-acre (24 ha) Stuyvesant family bouwerie (or farm).

[4] His paternal grandparents were Nicholas William Stuyvesant and Elizabeth (née Van Slichtenhorst) Stuyvesant (a daughter of Brant Van Slichtenhorst, the director of Rensselaerwyck; her sister, Margaretta, was the wife of Philip Pieterse Schuyler).

[9] His great-grandfather had purchased the land from the Dutch West India Company and in 1651 and by 1660 had built the family chapel.

[13] Together, Peter and Margaret were the parents of five children, two sons and three daughters, including:[4] The American portrait painter Gilbert Stuart made a portrait of Stuyvesant in c. 1793-95,[27] that was later owned by his 2x great-grandson, Winthrop Astor Chanler, and his son, Rear Admiral Hubert Winthrop Chanler (d. 1974),[28] Stuyvesant's 3x great-grandson.

[29] Stuyvesant died in New York City on October 7, 1805, a few days shy of his seventy-eighth birthday.

[31] Through his daughter Cornelia, he was a grandfather of at least twelve grandchildren including Petrus Stuyvesant Ten Broeck (1792–1849), a priest who married Lucretia Loring Cutter (daughter of Mayor Levi Cutter),[32] and Stephan Philip Van Rensselaer Ten Broeck (1802–1866), a physician who married Mary Nielson.