[2] The group (whose name, according to Swayzack, was chosen to join the word "scapegoats" and the saying "Don't get my goat," concluding that they felt the government had definitely gotten their goat at the time of formation)[3] began in 1991[4] with founding vocalists rappers OaTie Kato (James D'Angelo), and Swayzack (Patrick Shupe), with the Earlier lineup formation during the 1991 era featured the sisters Love and Rucyl Mills[5] and Oatie's brother Vinnie Angel.

[6] Unusually for a rap group, the Goats had a full musical band as well, which included drummer Chuck Treece and multi-instrumentalists Pierce Ternay and bassist E.J.

Mark Boyce ( Boss Hogg, Delta 72, and G. Love and Special Sauce) contributed keyboards and voiced many of the characters on "Tricks of the Shade" A Ruff House promotion photo shows an eight-piece lineup.

[10] Later projects have included working alongside his brother directing and writing the 2007 film, The Orange Thief, which won a number of festival circuit awards, and founding the group Jimmy Luxury in 2009 which was signed to Sony Records.

In the introduction to the 2019 book about Ruffhouse Records, by Chris Schwartz, The Roots lead man QuestLove writes that the Goats requested his band to warm up for them, resulting in their first live show.