Shortly after his move to Boston, Stebbins became the musical director of the Clarendon Street Baptist Church where Adoniram Judson Gordon was minister.

Stebbins' first work in this connection was to organize the choir for the meetings which Moody and Sankey were to hold in the great building erected for them in Chicago and which were to continue through October, November, and December.

He was also the last surviving member of the original group of men Moody had associated with him in his evangelistic work including Sankey, Whittle, Bliss, and James McGranahan.

Regarding Stebbins' work, aside from his occupying important positions in churches and his leadership in the great movement with which he was connected for so many years, he was frequently engaged to lead the singing at international and state conventions of YMCA, Sunday schools, Christian Endeavor, and other religious gatherings.

Much as his voice was heard in different parts of the world, he is remembered foremost by the music which he composed, which has long survived him and demonstrated an appeal across time and cultural boundaries.