How much time difference are you talking about here? difference of 1-3 frames (up to 0.05 second), or something bigger?

It's possible that the YouTube frame timer you are using is giving you inaccurate values (this can happen if the video buffers at any point), so the safest method is always to download the video (assuming your downloader is good) and time it with software.