Vileišis was a prominent Lithuanian engineer, political activist, publisher, and philanthropist who commissioned the palace in 1904 and supervised its construction.

[1] Vileišis selected the Neo-baroque style, because of the site's proximity to the baroque St. Peter and St. Paul's Church.

It was situated on a one-half hectare site, surrounded by a wrought iron fence and elaborately landscaped.

[3] The interior was decorated in Neo-classical and Rococo styles, featuring crown molding, sculptural elements, and pastel tiles.

Portraits, busts, and bas-reliefs of Lithuanian literary and cultural figures were displayed throughout the palace.

On January 9, 1907 the first Lithuanian Art Exhibition was held at the guesthouse, presenting the artwork of Mikalojus Konstantinas Čiurlionis and Antanas Žmuidzinavičius.

However, the long-missing copies of the Act of Independence of Lithuania, signed in 1918, were not found, despite a popular belief that they were hidden in the palace.