A year later, in 1905 he was snapped up by Woolwich Arsenal of the First Division and promptly became a regular in the side after making his debut against Liverpool on 2 September 1905.
His spell at Rangers only lasted nine months before he moved back to London again, rejoining Fulham for a transfer fee of £1,000.
Sharp then joined Fulham's local rivals Chelsea, leaving upon the cancellation of league football in 1915 due to World War I.
He left in April 1916 for military service with the Black Watch, but briefly returned to play for Dundee Hibs in February 1919.
However, at the age of 39 he made an unlikely comeback; after Fulham's inside left Harold Crockford missed the team bus to an away game at Bury on 17 April 1920, Sharp returned and scored in a 2–2 draw.