Personally I don't think adding categories cause you can theoretically come up with one is good. Something like that leads to having lots of similiar categories with one or two runners overall. If you think there is potential for a new and interesting category you should do a run of it to show it off. This can spark the interest of other runnes who might give it a try themselves. If these types of runs get to a certain degree of popularity then it potentially can be added to the board after reviewing and discussing it.

Now to your specific idea. No out of bounds does not change that much. Like SoapAgent already stated, Ladder Scroll and Boiler glitch are not out of bounds. The only out of bounds part in Any% is S3. If you want to avoid that you can either make a route that does not rely on the out of bounds in S3 or play Any% NMS. You also did not state why you would want a category without out of bounds in the first place or the advantages of this specific category.

Regarding the idea of a category that bans out of bounds and ladder/boiler glitches. I don't wanna sound elitist or something like that but to me that sounds a bit like "let's come up with a category and ban everything I am bad at or I can not do". Especially cause ladder glitches are optional for progression. They are not needed for any route to be completable. If you don't wanna do certain glitches cause you are not good at them or you don't think they are fun, then do a run without them. As of now the primary "no heavy glitches" category is Any% NMS, which is what I think you are looking for.