The Elms was originally the family home of William and Sarah Powell, built in 1896 to a design by T. P.

[1][2] Elmslie School was founded in 1918 by sisters Elizabeth, Polly and Peggie Brodie.

[6] On 15 March 1995 English Heritage designated the Elms a Grade II listed building.

[1] The Elms is a two-storey house built on an L-shaped plan, of red brick, with a sandstone front façade.

[1] During the building's use as a school the following additions were made to the site: gymnasium and assembly hall (1938), more classrooms in the Fisher block (1952), a chapel (1959) and VI Form Centre and music rooms (1988).