Bayly's fame rests on his book The Practice of Piety, directing a Christian how to walk that he may please God (date of first edition unknown; 3d ed., London, 1613; reprinted as ISBN 1-877611-66-2).
It reached its 74th edition in 1821 and has been translated into French, German, Dutch, Italian, Polish, Hungarian, Romansh, Welsh, and into the language of the Massachusetts Indians.
The Hungarian translation was by the puritan pastor and theologian Pál Medgyesi, first published in Debrecen in 1636.
Their son Nicholas Bayly represented Newry in the Irish House of Commons.
His eldest son, Henry Paget, 2nd Earl of Uxbridge gained fame at the Battle of Waterloo and was created Marquess of Anglesey (see this article for more information on the Bayly and Paget families).