I guess the time changer tool shouldn't be allowed in speedruns because it kind of mods the game?

Just don't hold any direction key while climbing. I once failed on this same strat too until the people in the discord gave me the above suggestion.