I have the same problem. My in-game fps without OBS preview/recording is about 125, no stutter, super smooth.
With OBS in preview/record the in-game fps goes down to about 90fps, which SHOULD be completely smooth (I use a 144hz monitor) but it's micro-stuttering like crazy, as if it is dropping every 3rd frame or something.
My setup:
Windows 10 tech preview
i7-4790k quad core
MSI Geforce GTX 970 4g GPU (driver version 349.90)
Things I've tried the past 3 days with no difference (stutter in game persists):
- With Xsplit and Shadowplay, while preview/recording show about 90 fps in-game and have NO stutter, perfectly smooth gameplay, so it's an interaction between OBS and H1Z1 (all other games I've tried are fine in OBS, as well).
- 32-bit and 64-bit versions of OBS cause the same stutter.
- Tried x264, Quick Sync, and NVENC encoders.
- Exhaustively tried every setting combination in OBS, hours on end. Including turning off encoding while previewing, makes no difference, so that sounds like it's not the encoding (also tried resolution downscale 3.00, which is 640x360 and no difference, and tried going various encoding frames per second as per some posts I've read on what to try - 15, 25, 28, 29, 30).
- With ONLY the webcam selected, (not even game added to the scene) when I turn on preview/record in OBS while H1Z1 is running it causes the stutter.
- Turn off preview window, minimizing OBS makes no difference.
- Went to single monitor in windows settings, as well as trying to completely unplug second monitor
- Plugged in 2nd monitor to the on-board graphics (Intel 4600 on chip GPU)
- Set 144hz monitor to 120hz, 60hz, tried with and without in-game v-sync, and Nvidia control panel force vsync (on, off, adaptive all result in no change in the stutter)
- uninstalling and re-installing OBS
- Overclocking my CPU and GPU, and setting them all at default cause no change
- Various settings of process priority in Task Manager (H1Z1 and OBS): tried every combination of normal, high, realtime priority, no change whatsoever.
- In-game settings from ultra to very low, max to minimum render distance, Ambient Occlusion checked/unchecked, tweaking the H1Z1 useroptions.ini or leaving it all default, nothing changes in the stutter regardless of the reported FPS
- Probably more things that I'm forgetting, it's been a long process.
So, my conclusion is: OBS and H1Z1 have some currently un-fixable problem even when OBS is NOT encoding while previewing or recording, causing the game to not report lost frames per second, but still cause a consistent stutter that doesn't change no matter what settings are modified.
I have no idea what to try next. It's like there's some hidden check-box in OBS that is interacting weird with this particular game (trust me, I've tried them all, but I'll do it again if people have ideas). What sucks is this is the single game I want to stream.
I haven't actually tried streaming to Twitch instead of preview/record, so I'll try that just in case it just works miraculously. (Didn't want to stream with this problem).