Presumably, the cave castle was built around 1275 by the Lords of Hölnstein, was sold in parts again and again from 1388 on, and was inhabited by Renhard Nerer, son-in-law of Konrad von Hölnstein, in 1431. In 1474 the entire castle was sold to Count Jos. Niklas von Zollern. Count Eitel Friedrich von Zollern had "the tower on the castle stable near Stetten" demolished in 1585. In 1985, the ruins were repaired by the city of Burladingen.
The former castle complex with pre-fortification, protected by an eastern and southern wall with ditches, had a large and small cave as well as a passage cave and had a donjon with vaulted cellar, castle courtyard and buildings. Extensive remains of the walls of the complex are still preserved.