Always Stay Sweet is a compilation album by His Name Is Alive, released by 4AD on February 23, 1999.

[3] Always Stay Sweet is one of the rare 4AD albums that was released in the USA only, and not the label's native UK.

It is a compilation of tracks from His Name Is Alive's first five records for the label, all of which—except for Stars on ESP—were out of print in America at the time.

No tracks from 1998's Ft. Lake are included at all, although the front cover was based on the inside sleeve of that album.

A version of the CD released by Mexican label Opción Sónica included two more songs from Stars on ESP and a rare track from the 1994 4AD compilation All Virgos Are Mad.