The structure, which is used as the local public library, is a Grade II listed building.

[2] After the building was found to be in state of disrepair,[3] a second town hall was erected, using stone from the ruins of Llandovery Castle, in around 1535.

[1] The current structure, the fourth municipal building, was designed by Richard Kyrke Penson in the Italianate style, built in stone and was completed in 1858.

The design involved a symmetrical main frontage with three bays facing southwest onto the Market Square; the ground floor, which was formed of coursed limestone, featured three openings with imposts, voussoirs and keystones, while the first floor, which was rendered, was fenestrated by three sash windows.

[10] An extensive programme of restoration works, which involved the fitting of a disabled lift and improved fire-alarm systems to allow the first floor to be used as a public library, was carried out at a cost of £100,000 and completed in 2003.