[1] He attended Toms River High School South, where he was named The Star-Ledger's state player of the year in 2001.

[2][3][4] The Detroit Tigers selected Frazier in the third round of the 2004 Major League Baseball draft.

In 2011, he signed with the Washington Nationals organization with an invitation to Spring Training, but was ultimately sent down to their farm team, the Syracuse Chiefs.

He spent the beginning of the 2012 season with Reynosa Broncos of the Mexican League before being placed on waivers and re–signing with the Toledo Mud Hens, the Triple–A team of the Detroit Tigers.

Jeff still lives in New Jersey and runs a baseball clinic called “Frazier Baseball” located in Toms River at the Toms River little league field known as Frazier Field with his older brother, Charlie.