Hi Beast96GT,
Ah, so you're using surround monitors. I've never done that before. This is just a guess but I'm not sure 50000 would be enough for 6000x1080. 50000 works well for me but I'm only game- or window-capturing one 1920x1080 monitor and downscaling that in OBS to 1280x720 (or 960x540 lately) with lanczos. For THREE monitors' worth of 1920x1080 frames at your selected framerate, I wouldn't be surprised if you need to raise that max bitrate and buffer size up higher.
I don't have a lot of details on the maximum bitrate/buffer sizes of different NVidia cards - I'm sure it's out there somewhere. I do seem to remember reading a couple years ago that the Kepler (higher end 6xx series) GPU chips could handle higher NVEnc bitrates than older/lesser generations. I had used values as high as 100000 without problems with then-current OBS versions and my older Core2 Quad (Q9650) and an EVGA GTX680 FTW to do 1280x720@30fps, and I don't think 100000 was the upper limit on the GTX680. I'm using 2 GTX980Ti's in SLI now with an overclocked i7-5960X, but 50000 is easier on my transcoder rig than higher values at the slower x264 ffmpeg presets I prefer/need to use for
$this_game.
It it was me, I'd try 150000 bitrate and 150000 (non-custom) buffer size and work down from there.
Anywho, here's some details of a 50mbit 1280x720@60fps config that is probably the best I came up with for
$this_game.
Encoding tab
- NVidia NVENC
- Enable CBR checked
- Enable CBR padding checked
- Use Custom Buffer Size unchecked
- Max Bitrate (kb/s): 50000
Video tab
- Base Resolution: 1920x1080
- Aspect Ratio: 16:9
- Resolution Downscale: 1.50 (1280x720)
- Filter: Lanczos (best detail, 36 samples)
- FPS: 60
- Disable Aero: unchecked
I generally use game capture as a source, although window capture also seems to work equally well. It's Windows 7 and I'm not using Monitor Capture so there is no good reason to turn the Disable Aero checkbox on.
Advanced tab
- Use Multithreaded Optimizations checked
- Process Priority Class: Normal
- Scene Buffering Time: 700
- Disable Encoding While Previewing checked
- NVEnc Preset: High Quality Low Latency
- Encoding Profile: High
- Keyframe Interval: 2
- Use CFR: unchecked
- (everything else in this tab is unchecked - the default)
All the usual disclaimers apply - YMMV - what works well for you will depend on your system hardware, peculiarities of your OS, what game you're playing, what graphics settings you are using in the game, what other shizzle you have running, and possibly the phase of the moon and solar particle count.
You will need to plan on tuning the output to your game, system, graphics settings, etc. until you are happy with it.
PS: I would recommend also saving a local copy of the file under the Broadcast Settings tab (Automatically save stream to file) while you are troubleshooting, so you have a way to know if a problem you are seeing in the final output from your 2nd PC (transcoder box) was also present in the original 50mbit stream coming from NvENC/OBS or not. (ie, are the encoder settings on the 2nd PC causing the problem or was the problem already there before the stream was transcoded?) Just remember these files will be huge.
Good luck!