The group released, Heaven on Earth in 2009 and Never Going Back in 2010 independently.
They have released 4 live albums, Standing in 2012, Kingdom in 2014, Take Heart in 2016 and Sand and Stars in 2017.
In May 2017, after the release of Sand and Stars, worship pastors David and Nicole Binion (with daughter Madison "Gracie" Binion or MDSN) felt God was telling them that their time with Covenant Church was coming to an end.
[2] Covenant Worship is from Dallas, where they began in 2009[3][4] with four members, David Binion, Nicole Binion, Joshua Dufrene, and Colin Edge, while they were members of Covenant Church, an interdenominational congregation, founded by pastors Mike and Kathy Hayes, in 1976.
[3][4][5] The band started as a musical entity in 2009, with their first independently-made album, Heaven on Earth and it was released on October 27, 2009, from Covenant Worship.