I just completed a 10:24 Set Seed run, It could have been a sub 10, but the Endermen kept getting in my way. Are there any tips/tricks to avoid Enderman attacks in the End or is it just RNG?

Endermen only get mad if you look at them. What I usually do is go into 3rd person and look at the ground. So you can still see everything, but no Endermen will attack.