When I'm doing wall kicks to go up the elevator shaft after the pole in BitFS to save time, the camera always gets stuck below the second floor of the level where the elevator leads to. Getting back to a playable camera perspective costs almost more time than just riding the elevator without doing any wallkicks.

How can I avoid having the camera stuck there?

Try posting in the SM64 forum instead.