In 1976, Tower, along with E. Barry Ryan, founded Classic magazine, a publication dedicated to Thoroughbred and Standardbred racing as well as show jumping events.
The magazine reported on horse racing matters not only from North America but from around the world as well, and won Media Eclipse Awards in 1976-77.
In 1968, Tower married Joan Baker Spear, the former wife of Life photographer Eliot Elisofon.
He and his wife decided to make Aiken their home and moved into a mansion called Joye Cottage built at the beginning of the 20th century by great-grandfather William Collins Whitney.
While living there, the couple became instrumental in the creation of the Aiken Thoroughbred Racing Hall of Fame and Museum.