After visiting London, England, Smith and Willison took an interest in electronica's rise in popularity, deciding to implement this to their more guitar-driven sound.
The band released their debut self titled album in 2000, under major label Island Records, but only received modest success.
During his time in Caviar, Suh would also play in the power-pop band Woolworthy, with whom he reunited with in 2023 to record some tracks for their album "Electric Heartbreak."
Safeway has featured in its TV commercials two songs from Thin Mercury Sound, including "Clean Getaway" in the summer of 2005 and "Lioness" in 2004.
"Tangerine Speedo" was also featured in the ending of the 2003 film The Cat in the Hat, a movie adaptation of the Dr. Seuss book of the same name, as an instrumental.