I might be okay with limiting rerolls to a certain amount per item, but removing it completely benefits classes that have high base damage and range (like rogue, sorc, necro), due to how powerful kiting is. Try rolling into Cathedral of light at level 35 or 36 on a barbarian with no rerolls or without full aspects on. Having to engage in melee range with mobs that can 2 shot you is rough.

Also, some classes have a naturally higher variance on gear, like druid with all the extra damage types available because of elements, companions etc. Their gear just spawns with a larger stat pool.

I guess you could just say that different classes will always be different. It's just a matter of quality of life IMO.