The foundation of the Castle of Gioia del Colle dates back to the mid-9th century during the Byzantine influence of the Apulian territory. The first nucleus of the castle had a quadrangular fortified plan with a central courtyard. It represented a defensive outpost aimed to the control of the ancient roads connecting the Adriatic Sea to the Ionian basin, as well as to link the west uplands of Murgia to the east front of Apulia. It was also used as shelter for the population against the enemies’ attacks.During the Norman period, about between the XI and the XII centuries, the castle was converted into a medieval fortress by the owner Riccardo D’Altavilla, known as “The Seneschal”. Under his direction, the castle was enlarged on the north side, with the construction of the De Rossi tower. From some studies, it emerges that the enlargement intervention made under the Reign of Norman King Ruggero II led to the erection of two other towers in the northeast and northwest corners of the castle. The castle was subsequently destroyed by the raids of Guglielmo I called “Il Malo” in the 1156, but there are no information about the castle morphology after this date.

The renaissance of the castle is due to the hand of the Emperor Fredrik II of Swabia, which promoted a restoration of the fortress of Gioia del Colle once returned from the VI crusade in 1230. The intervention gave to the castle the actual monumental configuration, with the curtain walls, the access portals and the central courtyard. In details, new rooms took place at the ground floor, such as the kitchen, some storages and stables. Upstairs, the castle was equipped with new representative and residential halls. The Swabian restoration also led to the construction of the southeast tower named “Imperatrice”.After the 1266, the castle firstly came under control of the Angevin Reign and, then, under the domination of the Aragon royal family, which transformed the military fortress into a residential mansion. Afterwards, several new openings - first opened only in the courtyard - were built on the external curtain walls according to the new residential vocation of the castle.

Since the XVII century, the castle started to be abandoned and disfigured, with an overall deterioration worsened after the earthquake of the 1786, which led to the collapse of the northeast tower, subsequently destroyed in the 1929.

In the 18th century, the castle was acquired by Donna Maria Emanuela Caracciolo, which promoted some restoration works of the first floor, especially on the east curtain wall. About in the years 1806-1868, the inner curtain walls, on the first floor, was restored giving them the actual aspect.Finally, in the early XX century, the architect Pantaleo directed some intervention aimed to the restoration of the historical ancient aspect of the castle. In fact, under his supervision, the large arch of the north curtain and the south staircase were demolished, adorning the faced with new mullioned openings. In this occasion, about between the 1907 and the 1909, a new staircase with an elegant lodge was built for the access to the throne hall on the first floor. The throne and the stone furniture of the hall also correspond to this period.