His maternal uncle, John Carroll became the first Catholic Bishop appointed for the United States, and traveled from his Maryland base into Virginia occasionally to conduct religious services at Brent family properties.

In 1789 or 1787, Brent married Mary Young—the daughter of Notley Young, a plantation owner in Prince George's County, Maryland.

A few years later, Young's property was among those annexed by the Federal government for the new national capital, making Brent one of the first residents of the newly created City of Washington.

He soon took over his father's businesses, selling sandstone to the U.S. government for the White House, U.S. Capitol, and other early construction projects in the District of Columbia and thereby becoming one of the capital's most prominent merchants.

[6] During his lifetime, Brent also served as Paymaster-General of the United States Army,[7] Judge of the Orphan's Court for Washington County,[8] and Chairman of the Board of Trustees of the Public Schools.