I found that you can make the enemy retreat by rushing at them, but I would just get hit

I believe the default key is 'F' when you're near to push them away, but you need your stamina to not be empty. If you also push it will drain your stamina completely and you can't do it again