The Wäscherburg, which dates back to the first half of the 13th century due to its humpback ashlars, stonemason's marks and pincer holes, functioned as a Staufer servant's castle.
The oldest surviving document from 1271 mentions a knight named Konrad, called Wascher, and his son of the same name. In this document, both renounce their bailiwick over certain goods belonging to Lorch Abbey and exchange a manor in Buron for goods in Nibelgau. Knight Konrad gave his name to the castle.
In 1274, the imperial court prince Walter von Limpurg pledged his tower in Staufen together with the castle settlement and all associated properties and people on the other side of the Rems river as well as the patronage rights of the church in Giengen to his son-in-law Ulrich von Rechberg and his brothers for 450 pounds Heller. The Lords of Staufen, to whom Knight Konrad belonged, therefore appear to have been servants of the Limpurger. It is possible that it was the Limpurgs who built Wäscherburg Castle around half a century before this pledge.