Niyongabire was born in Burundi, and spent his early childhood in Tanzania, before migrating to Australia with his family at age seven.

[2] In Australia, he played youth football with the Playford City Patriots and Gawler, before joining Adelaide United at age 17.

[3] On 14 January 2018, he was called up to the Adelaide United first team in the A-League Men, making his professional debut against Sydney.

[10] Niyongabire made his debut for Valour FC on 16 April 2023 against York United, recording an assist in the match.

[12][13] On 16 November 2022, he made his debut for the Burundi national football team in a friendly against Ivory Coast.