I started the timer when I clicked "yes", and stopped the timer when I bought the last color thus completing the game.

Mod note: Removed milliseconds