Mineta formed the punk rock band GOING STEADY in 1996, which included his high school classmate Murai Mamoru (村井守) on drums.
The band was signed to Libra Records—part of the larger independent label UK Project—from the release of their first single "You & I" in 1999 until they formed their own label Hatsukoi Moudo Gakuen (初恋妄°C学園) (also a sublabel of UK Project), which released GOING STEADY's fifth single "Wakamonotachi / Youji to Tsuki no Hime" (若者たち / 夜王子と月の姫) and all material from GOING STEADY, Ging Nang Boyz and their related projects thereafter.
That year, an Elephant Kashimashi tribute album titled Hanaotoko (花男) was released, and it featured a solo a cappella recording by Mineta under the moniker Ging Nang Boyz (銀杏BOYZ).
On the night of 28 July 2007, when he appeared in a concert in Taipei, Taiwan, he took off his underwear on stage and showed his lower body and prompting an interrogation by police authorities.
Afterwards, the document was sent to the public on charges of obscene neglect, paid a fine of 9,000 Taiwanese dollars and returned to Japan on the following day (he informed the local people who wanted the story of the article, not the audience nor stakeholder journalists).
On 20 April 2009, at a preliminary show preview of the film Shikisoku Generation (directed by Tomorowo Taguchi), an interview conducted for a reporter to the performer Asami Usuda with frequent sexual harassment questions such as "free sex faction?"