He was signed by the Baltimore Ravens as an undrafted free agent in 2009 and also played for the Miami Dolphins, New Orleans Saints and Philadelphia Eagles.

Ellerbe attended Richmond Senior High School in Rockingham, North Carolina, where he was a two-sport star in football and track.

He was named the Defensive MVP of the 2003 Shrine Bowl (NC-SC All-Star Game), in which he had nine tackles, three pass break-ups, and one interception.

In a 2010 preseason win against the St. Louis Rams, Ellerbe returned an interception 45 yards for a touchdown but was yelled at on the sidelines by head coach John Harbaugh for showboating.

Ellerbe made the roster as a backup linebacker behind Jameel McClain, who also was signed by Baltimore as an undrafted free agent.

This was one of the three turnovers by the Patriots that allowed the Ravens to win 28-13 and advance to Super Bowl XLVII, where they would defeat the San Francisco 49ers 34-31.

On March 13, 2015, Ellerbe was traded along with a third round pick to the New Orleans Saints in exchange for wide receiver Kenny Stills.

[12] On November 12, 2017, Ellerbe signed with the Philadelphia Eagles, reuniting him with former teammates Corey Graham and Torrey Smith.