I just noticed that anyone can see the last time I was online on speedrun.com. Is there any way to change this feature? I cannot find it in settings but I know it must be there.

I don't think there is a way to hide that info. Although if it did exist, it probably wouldn't be available to anyone who moderates a game, since runners need to be able to see if the moderators are still active on the site.