Gresser entered public service in Queens in 1898 and served as Commissioner of Public Works under Borough President Joseph Bermel.

When Bermel suddenly resigned his office amid a political scandal in 1908, Gresser and Joseph Cassidy were contenders to take over the rest of his term.

Cassidy was favored, having already held the office, but Gresser was named instead.

These charges were brought to Governor Charles Evans Hughes, who appointed lawyer Samuel H. Ordway to investigate.

After a lengthy investigation, Ordway recommended Gresser's removal for incompetence and inefficiency, and Governor John A. Dix removed Gresser from office on September 27, 1911.