Brown attended Saint Mary's College High School, where he played as a cornerback and wide receiver.
In 2003, he was moved to left cornerback where he started six out of the eight games he appeared in, finishing with 16 tackles, two interceptions and one pass defensed.
He finished his college career with 31 starts, 111 tackles (1.5 for loss), 10 interceptions, 22 passes defensed and nine receptions for 139 yards.
At a pro day event hosted by San Jose State on March 6, 2007, Brown recorded a 40-yard dash time of 4.32 seconds.
[6][irrelevant citation] After spending the 2009 season out of football, Brown signed a future contract with the New York Giants on January 6, 2010.