He played college football at West Virginia, and was selected by the Carolina Panthers in the third round of the 2016 NFL draft.

Worley attended the William Penn Charter School and was a standout receiver and safety for head coach Jeff Humble.

As a junior, Worley earned 1st Team All-Big 12 honors after finishing among the nation's leaders with 6 interceptions and 12 pass breakups.

[7] He opened the 2016 NFL season as third on the cornerback depth chart, behind veteran Bené Benwikere and fellow rookie James Bradberry.

[9] Worley steadily improved throughout the year and finished the season ranked as the twelfth best cornerback against the run by respected analytical site Pro Football Focus.

On March 9, 2018, the Panthers agreed to trade Worley to the Philadelphia Eagles in exchange for wide receiver Torrey Smith.

[12] On April 15, 2018, the Philadelphia Police Department arrested Worley for driving under the influence, disorderly conduct, and violation of the uniform firearms act.

[18] He finished the season playing in 10 games with nine starts, recording 33 tackles, seven passes defensed and one interception.On March 7, 2019, the Raiders placed a second-round restricted free agent tender on Worley.

[19] In week 9 against the Detroit Lions, Worley recorded a one-handed interception off Matthew Stafford, that was intended for wide receiver Kenny Golladay in the endzone during the 31–24 win.

He started 15 games at left cornerback, totaling 58 tackles, one interception, 8 passes defensed and one fumble recovery.

[21] Throughout training camp, Worley competed to be the starting right cornerback against Anthony Brown and rookie Trevon Diggs.

In the sixth game against the Arizona Cardinals, he was benched after giving up an 80-yard touchdown reception to wide receiver Christian Kirk, while being in zone coverage.

His defensive snaps were limited the rest of the way, until being released on October 28, 2020, as part of a roster purge that included free agency acquisitions Dontari Poe and Everson Griffen.

[25] On December 9, 2020, Worley was signed by the Las Vegas Raiders off the Bills' practice squad, to provide depth with injuries suffered by Damon Arnette, Lamarcus Joyner and Johnathan Abram.

He was named a starter at cornerback in the season finale against the Cincinnati Bengals, making 5 tackles and 2 passes defensed, while helping to defend wide receiver Ja'Marr Chase.

[47] Worley had three game day elevations, including his first start with the Titans on Week 12's win against the Houston Texans, substituting at safety for a sick Amani Hooker.

[48] Worley started as cornerback on Week 13's loss against the Washington Commanders, recording a career high 17 tackles.