According to local history, the first station agent, Seth Raynor, who was a patriot during the American Revolutionary War, painted over the "St. George’s," leaving "Manor" exposed, because it reminded him of colonial domination.

The town name changed to Manorville with opening of the post office, but timetables and LIRR documents retained the name "Manor" until either 1907 or 1908.

[2] The first station house was razed in September 1869, the same year that Manorville became the western terminus of the Sag Harbor Branch, which was built by Oliver Charlick to prevent the South Side Railroad of Long Island from extending its main line east of Patchogue.

Manorville was also intended to be the terminus of one of two formerly proposed extensions of the Wading River Branch.

A former hotel and restaurant now known as The Maples Inn, which served commuters from both branches, still exists to this day.