Jolimont railway station is at the top of a ridge, which extends towards Bridge Road in Richmond, from which Jolimont slopes downwards towards the Yarra River and the residential section to the north slopes gradually towards the flatter areas of Fitzroy and Collingwood to the north and Richmond to the south.

The area now known as East Melbourne was inhabited from an estimated 31,000 to 40,000 years ago[2] and Eastern Hill was originally known as Ngár-go (or "high ground") by the Wurundjeri along with Fitzroy.

[3] The flat ground known today as Jolimont extending toward the Yarra was part of the area also known by the Wurundjeri as Quo-Yung (or "dead trees").

It was named East Melbourne in 1837 by Port Phillip District surveyor Robert Hoddle, but was not actually settled until 1840, some time after neighbouring Fitzroy and Collingwood.

Among the first settlers was Charles La Trobe, who built a transportable dwelling in 1840[4] and wealthy professionals followed, establishing mansions there.

The Becton development at Jolimont, modelled on a picturesque Georgian village, created one of inner-city Melbourne's first exclusive enclaves.

East Melbourne's proximity to the city, its small size and its relatively unspoilt streetscapes ensure its property is expensive and highly sought after.

[6] East Melbourne is home to the Government of Victoria in the Parliamentary precinct at Spring Street and Treasury Place.

Other notable buildings include the Arts & Crafts style of the Victorian Artists Society (1892) by Richard Speight and Harry Tompkins, the Eastern Hill Fire Station (1893) and the East Melbourne Synagogue (1877) by Crouch & Wilson.

While notable terrace housing is predominant in the area, the suburb also has some fine remnant mansions, the oldest and largest in East Melbourne being the blue stone colonial mansion Bishopscourt (designed by Newson & Blackburn), which dates back to 1853, was used as Victoria's Government House in 1874–1876 and has been the residence for all of Melbourne's Anglican Bishops and Archbishops since its completion.

The two-storey house at 157 Hotham Street, built in 1861, is notable as a rare example of bluestone gothic applied to residential architecture.

Completed in 1887 and designed by architect firm Tappin, Gilbert and Dennehy, this impressive red brick building dominates a main residential corner.

One unique example of the architectural legacy is the "Dorijo" apartment building, located at 458 Victoria Parade.

The Dallas Brooks Hall, one of Australia's finest examples of the "stripped classical" style, was completed in 1969 and has served as a major events venue for many years.

The building caused controversy after 2001 when it owners, Freemasons Victoria announced that it was to be sold and demolished to make way for multi-purpose commercial development.

East Melbourne is also served by rail, with two main stations, Parliament underground station on Spring Street (part of the City Loop that runs underneath Melbourne) and Jolimont, on the Hurstbridge and Mernda lines, which is used primarily by patrons attending events at the MCG.

The first superintendent of the Port Phillip District, and later lieutenant-governor, Charles La Trobe, lived in Jolimont with his family in a pre-fabricated cottage.