The southeastern part of the municipal territory extends into the Upper Sázava Hills.

The market town proper is situated in a meander of the Sázava River.

[4] Kácov is located on the railway line Čerčany–Ledeč nad Sázavou.

It was built in the Baroque style in 1726–1733 for Duchess Anna Maria Franziska of Saxe-Lauenburg on the site of an older and smaller castle.

Since 2008, it has been owned by the market town of Kácov and is open to the public.