In 1757, he was stationed at Fort William Henry, at the head of Lake George, and during that year participated in battles which went badly for the provincial troops.

In 1758, he enlisted a second time in General James Abercrombie's attempted invasion of Canada, then held by the French.

He was part of a band of 100 men under the command of Major Putnam and accompanied by Lord Howe that went on a scouting expedition.

Putnam and Baker and their men cut their way through the French ranks, charged them in the rear, and after being reinforced killed 300 of the enemy and captured 143 prisoners.

In 1764, Remember, Desire, and their small son Ozi moved to Arlington, now in Vermont, and built a grist mill.

Following that, he served as a scout for General Phillip Schuyler in the area around St. John's, where the English troops and Native Americans were camped.

The Indians plundered the body, cut off Baker's head, raised it upon a pole, and carried it in triumph to Saint-Jean-sur-Richelieu, which horrified the British officers there.