The Baroque building, also known as the "Jewish house" is the oldest monument house in the pedestrian street of the city. In the 15th century, the Pethő Manor stood on the spot and the town's landlord was the Pethő family from whom Kristóf Festetics purchased the land in 1739. The current outlook of the building was completed during a renovation in the 18th century. Notable features of the building are the arcades and the stone framed windows.

In the beginning of the 19th century, the Goldmark family, who were working for the Festetics family, live in the Pethő House. In 1830, the famous composer Károly Goldmark (Carl Goldmark) was born in the house as one of the 20 children of a Jewish cantor. His most famous composition is the opera Queen of Sheba written in 1857. There is also a plaque of the composer on the wall of the house.

The building itself can not be visited but the courtyard and the synagogue, which has its entrance from there, can be.