He was left with a small garrison at a fort built at Ossipee before Lovewell's Fight near the Abenaki village of Pequewket (within what is now Fryeburg, Maine).

In 1744, during King George's War, he became a captain of scouts (snowshoe men) and led a company protecting the frontier of New Hampshire from Indian attack.

At the outbreak of the French and Indian War in 1754, Goffe rejoined the New Hampshire Militia and served in Joseph Blanchard's Regiment.

He saw action at the battles of Lake George, Fort William Henry, Carillon, Ticonderoga and Montreal, during which time he rose to the rank of colonel and became the commander of the New Hampshire Provincial Regiment.

In 1760, while en route to Crown Point, the regiment completed work begun in the fall of 1759 by Major Hawks on the Crown Point Military Road, from Fort at Number 4 in what is now Charlestown, New Hampshire, to the northernmost Black River Pond (Lake Amherst).