I'm pretty sure you don't need to destroy everything, maybe resigning conditions just the castles and TCs?