One thing with allowing any difficulty is that you are ultimately just going to lap the CPU earlier and potentially more than once, which could mean bumping into CPUs more often.