This took the longest time to figure out, but basically you see a row of ghosts in the back walking about.

The ghost which holds the gem needs to be in the archway that Pardoes will leave through before you click on the final 'tile' otherwise Pardoes will fall down and you will essentially game over.