so recently I was trying to do some speedrun of the game, but encountered a glitch that makes your IGT to start much later after opening the first door

It happens to me to

This must be a glitch

is there any way to fix it?

The big timer (white one) is off by around 2 seconds. The splits that are created by the game are correct.