​El Mvsev de Xàbia ocupa uno de los edificios más relevantes de la villa. Su primer propietario y constructor, Antoni Banyuls (muerto el 1662), fue un personaje de importancia por su proximidad al rey Felipe III, de quien fue mayordomo. El palacio, levantado durante la primera mitad del siglo XVII, presenta una magnífica fachada de piedra "tosca" en la cual destacan los "porxens" del piso superior. En el interior, las tres plantas en las que se divide, fueron muy transformadas en la segunda mitad del siglo XIX, siguiendo las modas de aquellos momentos de auge económico. De esta manera, sólo se conserva la pavimentación original con baldosas de barro y "mocadorets" en verde y blanco, en la sala VI. 

The Banyuls house (now the home of the Museum of Xàbia) is one of the town's most interesting buildings. Its builder and first owner, Antoni Banyuls (Xàbia 1582-1662) was a trusted servant of the Lord of Xàbia and Marquess of Denia and also served as majordomo (chief steward) for kings Felipe III and Felipe IV. The building was constructed in the first half of the 17th century, though it suffered glaring modifications during the second half of the 19th century, during the economic boom of the raisin trade,.The three storey house has two cellars and a unique facade of tosca stone.. The entrance is flanked by two large windows. Originally it had a mid-point arch which was lowered in the second half of the 19th century. The first floor has four balconies on the outside and conserves the original flooring of "mocadaret" (handkerchief) 17th century tiles in one of its rooms. The top floor is characterised by ten windows which conform to the typical portals of Valencian architecture at that time.