A south aisle with a rose window, designed by Raphael Brandon, was added in 1860,[4] and a chancel in red brick, by Bodley & Garner, in 1900–01.

The three-light window at the west end by Hugh Ray Easton, installed in 1932, shows Saint Andrew in the centre, flanked by scenes of baptism and confirmation.

[6] The east window of the Crucifixion was designed by Sir Ninian Comper (1900) and was erected in memory of Harry Scott of Ancrum (d 1889) by his stepdaughters Violet Cavendish-Bentinck and Hyacinth Jessup.

[7] There is a memorial stained glass window to Sir George Dance (1857–1932), a dramatist and theatrical manager, and his son Erik who died in a prison camp in World War II.

[8] There are also funerary hatchments at the back of the church dedicated to Lionel Tollemache, 4th Earl of Dysart and his wife Countess Grace.