He was born at "Matthew's Field," in Blooming Grove, New York in Orange County in the village founded by his grandfather of the same name.
He had two uncles who were supportive of the British efforts during the American Revolutionary War, David Mathews, the Loyalist Mayor of New York City, and his brother Fletcher.
Mathews' father James was arrested along with David and Fletcher in a suspected attempt to kidnap George Washington, known as the Hickey Plot.
Mathews pursued an academic course in Noah Webster's School at Goshen and at the academy at Hackensack, New Jersey.
He was bounty land claims commissioner in 1798 and served as Cavalry commander and brigadier general in the New York militia.