It was written by Ashanti along with its producers Irv Gotti and Demetrius "Demi-Doc" McGhee for her third studio album, Concrete Rose (2004).

The song contains interpolations from "Could I Be Falling in Love" (1974) by American blues and soul singer Syl Johnson.

"Don't Let Them" was written by Ashanti, Irv Gotti and Demetrius "Demi-Doc" McGhee and recorded for her third studio album, Concrete Rose (2004).

[2] In a negative review for Billboard, editor Chuck Taylor wrote about "Don't Let Them" that "because many of her sample-heavy novelty songs have become smash hits, the R&B siren has now found the courage to attempt singing without so many gimmicks and instruments engulfing her voice.

[4] It starts off with her from early in the morning and introduces the video play system, while depicting the on-and-off relationships between a couple.