Richardson served in the South Carolina Militia during the American Revolution and also in the Continental Army.

His grandson John Lawrence Manning[3] was the 65th governor of South Carolina (1852-1854) as well as a signer of the Ordinance of Secession.

His great-great grandson Richard Irvine Manning III served as a state legislator and as the 92nd governor from 1915 to 1919.

Richardson's great-great grandmother was Mary Browning (sister of the poet's ancestor).

His body was later dug up and his plantation burned down on the orders of British commander Banastre Tarleton, who was in the process of pillaging Richardson's home in an attempt to discover the location of Patriot militia commander Francis Marion.