He was born in Exeter and received his first musical instruction from his mother's sister, becoming, it is said, proficient on the harpsichord at age seven.
He was next placed under Hugh Bond and William Jackson of Exeter, remaining there until his 17th year, when he came to London under the patronage of the Earl of Uxbridge.
During his residence in London, he performed his celebrated "Storm"' at the Hanover Square Rooms, meeting with the approbation of Dr. Burney.
On 5 March 1795, an entry stats 'that the organist be placed under restrictions as to the use of the organ, and that the mayor have a master key to prevent him having access thereto.'
And on 16 July in the same year 'it is ordered that Mr. George Baker be in future prohibited from playing the piece of music called "The Storm"'.
The inhabitants of Stafford did not, therefore, concur in Dr. Burney's opinion as to the excellence of this piece, apparently its composer's chef d'œuvre.
In his later years, the eccentricities, which probably gave rise to a large proportion of his difficulties with the Stafford authorities, increased, and he was moreover afflicted with deafness.