The irregularity in shape is due to the presence of the Pineapple Hotel in the south-west corner and housing at other locations, presumably existing prior to the establishment of the park.

A vacant block of land at South Brisbane bounded by Melbourne Street, Stanley Street and Grey Street was trialled but was found to be frequently waterlogged after rain, so the soccer teams relocated to grounds behind the Pineapple Hotel (the ground is now the western part of Raymond Park).

The first competitive soccer matches in Brisbane were played at the Pineapple Sportsground in 1884.

Two air raid shelters were constructed at the eastern and western ends of Raymond Park.

Although most air raid shelters were demolished after the war, the eastern and western air raid shelters in Raymond Park are among the handful to survive, albeit with their outer walls removed.