With the temple to Fervus I managed to outrun the first additional lair spawn after many attempts. The wizard is pretty much needed to take down the 5th lair, gotta get lucky with him not dying. Enemies spawn south side of the lair so its best to build the wizard guild north of it.