He then attended classes and played baseball for Concordia College, an NCAA Division III school in Moorhead, Minnesota, where he was a three-time All-American.

In 2000, Coste signed with the Cleveland Indians organization, having gotten significant playing with then Triple-A affiliate Buffalo Bisons.

[1] Coste chose to go to Reading so that he could start and play every day, and because it would help the club if he was ready, rather than being Jason Jaramillo's backup at Triple-A Ottawa.

He entered as a pinch hitter in the eighth inning, and became the first player in 63 years to appear at least that late into a game but still record 4 hits.

On October 29, 2008, Coste became the first player that originated from Division III college baseball's MIAC to win a World Series.

[2] Due to starting first baseman Lance Berkman's injured calf, Coste found playing time at first base for the Astros.

2008 saw the release of Coste's second autobiography, "The 33-Year-Old Rookie: How I Finally Made it to the Big Leagues After Eleven Years in the Minors."

It includes nearly all the historical material found in his first book (independent baseball) as well as the time in the affiliated minor leagues.

[10] With the RedHawks, Coste led the franchise to a runner-up finish in the American Association in 2021, losing to the Kansas City Monarchs in the league finals.

The following season, the RedHawks defeated the Milwaukee Milkmen in five games to claim their first AA crown, 24 years after Coste earned a Northern League title with the franchise.