The album has been described as having an eclectic range of influences from art rock, indie pop and elements of new rave throughout the record, marking a major departure from the band's pop rock and indie rock-oriented sound.
The album spawned five singles ahead of the release, including "Illusions", "One Last Night on This Earth", and "Higher States".
Ulfilas' Alphabet was recording during Summer 2018 at RAK Studios in West London, where the band recruited Alex Robertshaw from Everything Everything for producing the album.
Pollock joked that he "can write a folk song and then next it could be dubstep, but I think it’s good to not judge those things".
"Illusions", "One Last Night on This Earth", and "The Changeover" came out in 2018, while "Higher States" and "Little Smart Houses" were released in 2019.