He was a typical pioneer minister, owning and operating a farm during most of his years as a Circuit Rider, Presiding Elder, and Bishop.
The Long home was a gateway between the East and West, and it stood as a typical wayside lodging place for ministers in their travels to and from conference sessions in Pennsylvania throughout this early pioneer period.
Joseph was the first elected Presiding Elder of the Western Conference, overseer of the Ohio work 1828-33.
For the next ten years, Joseph was a model local preacher, living at home and preaching only in the immediate neighborhood.
He served on the Tabor District until October 1843 when the General Conference chose him as the third Bishop of the Evangelical Association.