You have to stand on some specific places before you stretch, or you won't be able to get into the wall.

Wall Zip in Music World

Reach the ceiling and hold Left until you fall down, do this until you get stuck in the wall. Hold Down and Left and wait the screen to shake, after that, stop holding Down and keep pressing Left.

Wall Zip in Board Games World (only in all stages)