[3] He then made his home debut in a 2–2 draw with Hamilton Academical on the last day of the 2015–16 season, winning the man of the match award.

[9] Penrice scored his first goal of the 2019–20 season in a 2–0 win over Welsh side Connah's Quay Nomads in the Scottish Challenge Cup.

Penrice chose to stay at Thistle following their relegation making him and teammate Stuart Bannigan, the only two players left at the club from their time in the Premiership.

[12] Following winning the Scottish League One title with Thistle, Penrice left the club at the expiry of his contract to move to Premiership side Livingston, in a 'technical' swap deal with Scott Tiffoney heading in the other direction also on a free transfer.

[14] On 18 June 2024, Heart of Midlothian FC announced that Penrice had signed for the club with a three-year deal, taking the number 29 ahead of the 2024–25 Scottish Premiership season.