Olivia wasn't released on CD until 1990, when EMI in Japan issued it on their Pastmasters series.

It was finally released in a digitally remastered version by Festival Records Pty Ltd (Aust) in 1998.

Fans in the United States had to obtain one of these CD versions as an import, as the album has never been released there.

Other noteworthy songs on the album include her rendition of Chip Taylor's "Angel of the Morning", David Gates's "Everything I Own" and Newton-John's own "Changes".

In their review of "My Old Man's Got a Gun", Cashbox stated that "it's only a matter of time before the masses discover one of the most talented female songstresses around today.