Brown grew up in Lenox, Iowa and attended Lenox High School, where he played baseball, basketball, golf and ran track in addition to being a member of the school's eight-man football team as a defensive end and tight end.

[1] He was named first team All-State as a senior after recording 24 receptions for 388 yards and seven touchdowns on offense and 67 tackles, a state-leading 17 sacks and four fumble recoveries on defense.

[2] Brown redshirted his true freshman season at the University of Northern Iowa as he moved from tight end to offensive tackle and gained nearly 80 pounds (36 kg).

[5] As a redshirt junior, Brown started all of the Panthers' games and was named second team All-Missouri Valley Football Conference.

[6][7] Brown was named a preseason first team FCS All-American by Phil Steele before announcing that he would forgo his redshirt senior season, which was to be played in the spring due to COVID-19, and prepare for the 2021 NFL Draft.