[2] "Out There" features a guitar solo that has been singled out by Ned Raggett of AllMusic as "classic Dinosaur Jr."[3] The song also features chimes, which Ultimate Classic Rock noted as an example of the band "adding to [its] sonic palette.

"Out There" was a moderate alternative radio hit upon its release, aided by a music video featuring the band performing in the snow.

Ned Raggett of AllMusic described the song as "one of the most mournful things Mascis has recorded, with an especially yearning chorus" and praised the guitar solo as "fiery.

"[3] Josh Gray of Clash described Where You Been's "opening salvo of 'Out There' and 'Start Choppin'" as "better than sex, drugs and peanut butter (individually or all at once, it doesn't matter).

"[9] Timothy and Elizabeth Bracy of Stereogum named the song one of the "great tunes" from Where You Been, while Stevie Chick of the BBC said the song "opened the album with enough overdriven squalling and riffing to excite the teens in the Pearl Jam t-shirts.