Coming off an 18–14 record and a second-round NIT loss in 2002–03, the team returned all five starters for coach Tim Welsh's sixth season with the Friars.

[3] The team also lost two departing seniors, guard Kareem Hayletts and forward Stephen Traugott.

Following an 8–1 start that included a win over #14 Illinois, the Friars earned a #25 ranking in the AP Poll in time for their January 5 matchup with #18 Texas.

This was followed by two home losses to close out the regular season, and a #3 seed in the 2004 Big East men's basketball tournament.

Following a first-round bye, the Friars dropped a three-point game to Villanova in the quarterfinals, leading to a #5 seed in the NCAA tournament.