Silberman has stated that when beginning the band as a solo project, his approach to home recording and production was largely inspired by the techniques of lo-fi musician Phil Elverum (The Microphones and Mount Eerie); in particular, that of the critically acclaimed 2001 release, The Glow Pt.

[2] Silberman also noted that the album carries a theme of "religious misdirection", inspired by his own tendency to find the wrong solutions to his problems in life.

[2] After the release of In the Attic of the Universe Silberman recorded two EPs entitled Cold War and New York Hospitals, the latter featuring Michael Lerner and Sharon Van Etten as guests.

Shortly thereafter, Michael Lerner and Darby Cicci came on board transforming The Antlers into a collaborative group.

In February 2017, Siberman released the album Impermanence, which he recorded in up-state New York with Nicholas Principe.