On steam shop, go to Steam -> Settings. Then In-Game and In-Game fps counter. You will need to restart your game if it was open.

Be careful, if you record with game capture, the counter might not show up on screen. Window capture usually works.