Picked up OBS as a replacement for Shadowplays lack of OpenGL support recently and found it to work great with the NVENC hardware encoder, up until you play the file back. Recording Doom 2016 results in no in game stuttering, but the recorded file will fairly frequently drop to extremely low framerates and result in stuttering.
Settings:
Vsync is enabled in game.
Specs:
AMD FX 8350
GTX 970
12GB RAM
OBS x64
Recording to Kingston V300 SSD
Encoding using NVENC H.264
Settings:
Vsync is enabled in game.
Specs:
AMD FX 8350
GTX 970
12GB RAM
OBS x64
Recording to Kingston V300 SSD
Encoding using NVENC H.264