The church and its associated parish house were designed by Edward Tuckerman Potter, and serve as a memorial to Samuel Colt and members of his family.

It has a steeply pitched polychrome slate roof, with parapeted gable ends that have crosses at the peaks.

A square tower with buttresses rises at one of the crooks of the T, with a low crenellated battlement below the octagonal spire.

The interior features a variety of stone types in the construction of the floors and columns, and has heavy chestnut timbers in the roof framing.

The southwest entrance arch is carved with examples of the workers' tools used in the Samuel Colt's factory.