The grounds are part of the Fort Cumberland Walking Trail, signposted with plaques and detailed in a leaflet available from the visitor center.
Standing at the eastern end of the Washington Street Historic District, it is one of Maryland's examples of early Gothic Revival architecture.
The Parish house features elements typical of this style, such as a projecting pavilion, tall windows and roof, and deep architectural details.
The church and parish house sit on land that was originally Fort Cumberland, which served as a frontier outpost during the French and Indian War.
The only building to remain from the fort is the small cabin that was used by George Washington as his headquarters when he was in the Cumberland area with his Virginia troops.