Bug Report Potential Issue w/NVidia Driver v416.16 and NVENC


I found another thread on the problem I'm having here. After upgrading to NVidia's latest 416.16 driver, I can't get OBS to stop recording. Technically it never starts recording even though the "Record" button says it is. But hitting the button again locks OBS into the "Stopping Recording" and it never recovers. No files are written and I have to force kill the process.

Downgrading back to NVidia 411.70 fixed the issue for me. So: heads up.

19:13:19.422: [game-capture: 'Game Capture'] attempting to hook fullscreen process: RainbowSix.exe
19:13:19.425: [game-capture: 'Game Capture'] using helper (compatibility hook)
19:13:19.551: [game-capture: 'Game Capture'] hook not loaded yet, retrying..
19:13:22.421: [game-capture: 'Game Capture'] attempting to hook fullscreen process: RainbowSix.exe
19:13:22.613: [game-capture: 'Game Capture'] d3d11 shared texture capture successful
19:13:22.621: [game-capture: 'Game Capture'] shared texture capture successful
19:30:22.074: ---------------------------------
19:30:22.076: [NVENC encoder: 'recording_h264'] settings:
19:30:22.076:     rate_control: CBR
19:30:22.076:     bitrate:      75000
19:30:22.076:     cqp:          0
19:30:22.076:     keyint:       119
19:30:22.076:     preset:       default
19:30:22.076:     profile:      main
19:30:22.076:     level:        auto
19:30:22.076:     width:        3840
19:30:22.076:     height:       2160
19:30:22.076:     2-pass:       false
19:30:22.076:     b-frames:     2
19:30:22.076:     GPU:          0
19:30:22.528: ---------------------------------
19:30:22.528: [FFmpeg aac encoder: 'Gaming'] bitrate: 320, channels: 2, channel_layout: 3
19:30:22.531: ---------------------------------
19:30:22.531: [FFmpeg aac encoder: 'Microphone'] bitrate: 320, channels: 2, channel_layout: 3
19:30:22.532: ---------------------------------
19:30:22.532: [FFmpeg aac encoder: 'Comms'] bitrate: 320, channels: 2, channel_layout: 3
19:30:22.696: ==== Recording Start ===============================================
19:30:22.696: [ffmpeg muxer: 'adv_file_output'] Writing file 'D:/recorded/2018-10-06 19-30-22.mp4'...
19:30:22.945: [NVENC encoder: 'recording_h264'] nvenc_encode: Error encoding: Invalid argument
19:30:23.092: Error encoding with encoder 'recording_h264'
Last edited:



I've bounced back and forth between 411.17 and 416.16 countless times today and I can reproduce the issue at will. If I'm running 416.16: OBS will report that "Error encoding" message in the logs and not actually start writing an output file. The only way to stop OBS once it's in that state is to force kill the backgrounded process.

With 411.17: no problems at all.

Windows 10 Pro 64, v1809
NVidia v416.16
2 Titan X Pascal cards in SLI
OBS Studio 22.0.2 (64 bit)


Update on this problem: It appears to be an SLI thing with NVidia's own NVENC libraries. Both versions 416.16 and 416.34 are displaying the problem: if you have an SLI system and you upgrade to either of those versions, you very likely won't be able to use any NVENC-enabled application. Disabling SLI system-wide will likely bring functionality back. So will downgrading to 411.70.

I already have a case open with NVidia on this problem; within an hour of me opening it, they elevated it to their Level 2 guys. Others across the 'net are starting to complain about the same thing with their SLI systems.

I'm guessing a library hot fix is incoming, but don't quote me on that.


Final update: NVidia dropped 416.81 on Thursday, and one of the bug fixes was this very issue. So if you're running an SLI system and you want to record with NVENC, and you want to run the 416.xx train of drivers, make sure it's 416.81.