[1] The bank was established in April 1834 by the industrialist James Foster with an office in High Street, Stourbridge.
[2] The building had been Foster's residence before his move to Stourton Castle.
The first manager, John Amery and first cashier, Samuel Nock had living quarters in the bank building itself.
In the same year it opened a branch in Bromsgrove and took over the business of Oldaker, Tomes and Chattaway in Stratford-on-Avon.
The Bromsgrove branch was initially only open for 1 day per week, but in 1851, the company of Rufford Biggs failed, and the Stourbridge and Kidderminster obtained their premises at 93 High Street, Bromsgrove.