The church is a significant work of Frank Wills, a major proponent of the Gothic Revival.

It has a basically cruciform plan, with the tower taking up one of the short branches of the cross.

[2] The Anglican congregation in Milford was founded in the mid-18th century, with informal services beginning as early as the 1730s under the auspices of Samuel Johnson.

The present building was built in 1850-51 to replace the earlier structure, which was in need of extensive repairs.

Architect Frank Wills, a major proponent of the Ecclesiological movement which espoused a return to Gothic features for churches, was retained to design the new building.