There is an option to remove yourself as a moderator in Edit Game, under the Moderators section. Click the 3 dots beside your name and you should see a "Remove Moderator" option (though at one point it was only possible to demote yourself if you're a super mod, I don't remember if that was ever fixed or not. If not, it definitely should be).

Having it easily accessible beside the Follow button would likely result in a lot of accidental self-demotions (there's probably a confirmation dialog, but still, not something you want to easily be able to do by accident).

You can, though!

If you go to the edit game page, and go to moderators, you can see all moderators. Link: https://www.speedrun.com/OutDrive/editgame/moderators From there, click on the hamburger menu and press "remove moderator". However, Makkerdon probably just added you? Feel free to message him, he just got the board rights earlier today.