The neighbourhood is named for the Governor's Bridge that crosses the Moore Park Ravine from Douglas Crescent to Astley Avenue and connects the area to Rosedale.

Governor's Bridge's boundaries are the Canadian Pacific Railroad to the north, Bayview Avenue to the south and east, and Mud Creek as part of the Moore Park Ravine to its intersection with Pottery Road to the west.

The west part of the neighbourhood was quickly built up during the Roaring Twenties boom period, and most of the houses date from this era.

In 1959 Harry Frimerman, a Toronto land developer obtained permission from East York reeve Jack Allen to construct a set of apartment buildings on the site.

The position atop the ravine and next to the Don Valley Parkway made it into a prominent landmark and it was nicknamed the Bayview Ghost.

[5] East York rezoned the area for single family homes and the "Ghost" was finally demolished in November 1981 at the developer's expense.