[3] Baylson was a law clerk for Joseph Sloane in the Philadelphia Court of Common Pleas in 1965.

[3][4] In 1988 he was appointed by President Ronald Reagan as the United States attorney for the Eastern District, a position he held until 1993.

[4] He was confirmed by the United States Senate on April 30, 2002, and received his commission on June 19, 2002.

[3] Baylson was a founder, and later counsel, to Gaudenzia, Inc., the largest non-profit provider of drug, alcohol and mental health rehabilitation services in Pennsylvania.

Baylson is a member of the Advisory Committee on Civil Rules of the Committee on Rules of Practice and Procedure of the Judicial Conference of the United States, and is also adjunct professor at the University of Pennsylvania Law School and Temple University Beasley School of Law.