Later he served in a civilian capacity as clerk in the War Department and Indian Agent.

[5] Caleb Swan was a namesake of his father, a graduate of Harvard College, and one of the pioneer settlers of Fryeburg, Maine, who had been a lieutenant in the French and Indian War.

[8] In 1790, Swan was appointed Deputy Agent to the Creek Nation and ordered by Henry Knox, the Secretary of War, to follow Alexander McGillivray and the other Creek chiefs and warriors back to their homeland after they had signed the treaty of New York.

[11] On May 9, 1792, President George Washington appointed Swan paymaster of the troops of the United States, to reside with the army.

[15] In spite of being a Federalist, Swan was retained by President Jefferson after the enactment of the Military Peace Establishment Act in 1802.