In 2001, the label found success with its multi-platinum record inaugural release, Songs in A Minor, the debut album of Alicia Keys, which sold over 12 million copies worldwide.

Later, established artists like D'Angelo, Luther Vandross, Jamie Foxx, and Monica would join the J roster, the latter three going on to find multi-platinum success with the label.

The same year, J Records began functioning under the RCA Music Group, where Davis had been appointed president and CEO, and signed American Idol winners Fantasia and Ruben Studdard.

In March 2004, Full Surface and J released Cassidy's debut studio album, Split Personality.

In mid-2011, RCA Music Group underwent a restructuring which shuttered J along with sister labels Jive and Arista on October 7, 2011.