His brother Gregory Sharpe (1713–1771) was appointed Master of the Temple in 1763 and was chaplain to George III.

His brother William Sharpe of Brocklee Hill, Elstree in Hertfordshire (b. abt 1696 – d. 1767) was clerk of the council.

He served until his appointment by Frederick Calvert, 6th Baron Baltimore as the proprietary Maryland colonial governor.

Now a National Historic Landmark, Whitehall was designed by Joseph Horatio Anderson, who was also the architect of the Maryland State House.

Between 1760 and 1765, according to a 1912 biography, "The governor spent as much of his time as was possible at Whitehall, amusing himself with his favourite pursuit of farming", with most of the labor provided by enslaved people:No kinder master could be found, and his large retinue of negro slaves and indentured white servants were supremely happy.

[1] In 1763, Sharpsburg, Maryland, was named in honor of Sharpe by his friend and the town's founder, Joseph Chapline.