In 1661, his great-grandfather Langford bought Lynch's Castle (located on the Sumerhill demesne in County Meath) and many other townlands from The Rt Rev.
Rowley inherited his father's estates, including Lynch's Castle, which had been occupied by the Langfords since 1661.
In 1731, Rowley hired architects Sir Edward Lovett Pearce and Richard Cassels to build him a new Georgian mansion on the property, known as Summerhill House.
In 1743, upon entering parliament, Rowley purchased a large house on then fashionable Mary Street in the North of Dublin city.
Together, they lived at Summerhill, County Meath, and were the parents of:[1] His wife died in 1791 and was succeeded in her titles by their eldest son, Hercules.
[10] Through his daughter Jane, he was also a grandfather of Thomas Taylour, 1st Marquess of Headfort (1757–1829), who married Mary Quin (a granddaughter of Sir Henry Cavendish, 1st Baronet); Major Hon.
Henry Edward Taylour (1768–1852), who married a granddaughter of the 1st Viscount Doneraile); and Lady Henrietta Taylour (d. 1838), who married Chambré Brabazon Ponsonby-Barker MP (son of Chambré Brabazon Ponsonby).