It is noted for its historic parish church, a small late Federal style brick structure built in 1842.

After the passage of the Tucker Act, the church vestry successfully sued the U.S. government in the U.S. Court of Claims for $1000 damages, which was used for restoration.

After floods of the Potomac River, the vestry moved the chapel to high ground, and it was consecrated in 1912 as the Church of the Holy Trinity.

[2] As the years progressed, however, Holy Trinity proved more difficult to maintain, and on May 22, 1966, it was closed permanently, with the congregation returning to St. Paul's after extensive renovations.

It was rededicated October 5, 1969 by Bishop Harry Lee Dall, and in 1974, the Diocese of Maryland sold Holy Trinity to a Baptist congregation.