He also moved in the better social circles, and convinced a number of rich young men to join the organization.

Fowler had long lived beyond his means, and on May 10, 1860, was removed from his office as Postmaster and a warrant was issued for his arrest, accusing him of embezzling $155,554.

Fowler, who had also produced the $2,500 to buy off the Republican Peter P. Voorhis on city's Board of Supervisors, was staying at a hotel when the warrant for his arrest was issued.

The responsibility for Fowler's arrest was given to Isaiah Rynders, another Tammany operative who was serving as a United States marshal at the time.

On July 5, 1866, the District Attorney filed a nolle prosequi, saying that he no longer intended to prosecute Fowler for his misdeeds.