Leith Harp's first recorded matches were in the 1881–82 Edinburgh Shield, in which it reached the fourth round, made up of six clubs.

The club played at a junior level for most of its existence, and was successful in the Leith Cup on three occasions; it is first noted as having won the competition in 1884–85,[1] and was good enough to hold Heart of Midlothian to a draw in 1885–86.

In 1885–86, the Harp was so strong that it beat Pumpherston 5–0 despite playing the match with ten men;[3] the club reached the semi-final, and held the eventual winners Bo'ness to a draw.

The match was of particular importance to Bo'ness, which had won the competition twice in a row, and a third success would ensure that, under the terms of the deed of gift, the club could hold the trophy in perpetuity.

[14] Worse was to come in the King Cup, a competition in which the Harp had never had much success, when it was hammered 9–1 at home by East Linton, a side of no pedigree, in the first round.