On June 3, Robert E. Lee decided to begin his second invasion of Northern soil and accordingly ordered his army to withdraw the lines around Fredericksburg and move into the Shenandoah Valley.

To determine the validity of the various reports he was receiving, at 7 am on June 5, Major General Daniel Butterfield ordered the 6th Corps under John Sedgwick to prepare to lay bridges across the Rappahannock River at Franklin's Crossing, the Army of the Potomac's third attempt to do so within six months.

[1] By 5 pm on June 5, nearly all batteries of the 6th Corps had moved to Falmouth Heights and started shelling Confederates entrenched in rifle pits on the southern bank.

A hot fire fight ensued that was described as "severe" at times before the Union advance was halted and driven back across the river, suffering 57 casualties.

[citation needed] Learning that the majority of Lee's army was in Culpeper County, Virginia, Hooker ordered Brigadier General Alfred Pleasonton's cavalry to attack, resulting in the Battle of Brandy Station on June 9.