You can set some heavy settings using your own x264 attributes in OBS. You can for example use 'crf=1' and it will look very good and will consume a lot of cpu. You can also find some presets on the internet and type them by hand in custom x264 attributes in OBS.
Maybe also CABAC, best motion estimation method, Trellis, stuff like this.