Milltown is a hamlet in the town of Southeast located in Putnam County, New York, United States.

At this time, Milltown sat in the middle of the Oblong, a long-disputed strip of land between New York and Connecticut.

[3] Southeast's first library was established here[3] in 1825, operating out of Asa Raymond's general store & post office.

In times when water levels have been significantly low, remnants of nineteenth century Milltown, such as stone walls, home foundations, and roads, have been made visible.

The 500 acres (2.0 km2) extend from New York into the Joes Hill / Mill Plain section of Danbury.