So I recently tried out the DuckStation and I realized that there are settings that can make load times as fast, if not, faster than PSTV. And I was wondering, should we ban the DuckStation Emulator or should we allow it? Please let me know.

Which settings? N64 Emu has a similar problem (Vi Refresh Rate), so we just require to keep it at a certain value.
In general, Solarson and I have discussed adjusting PS times based on load times for PS/PS2/PSTV/Emu. So that's a possibility

It’s the Console setting in CD-ROM Emulation! Apparently you can go to 20x read speed and infinite Seek speed.