Code:
21:09:22.123: [jim-nvenc: 'simple_h264_stream'] settings:
21:09:22.123: rate_control: CBR
21:09:22.123: bitrate: 2500
21:09:22.123: cqp: 20
21:09:22.123: keyint: 120
21:09:22.123: preset: hp
21:09:22.123: profile: high
21:09:22.123: width: 1760
21:09:22.123: height: 1174
21:09:22.123: 2-pass: false
21:09:22.123: b-frames: 2
21:09:22.123: lookahead: false
21:09:22.123: psycho_aq: true
22:03:57.399: Output 'simple_stream': stopping
22:03:57.399: Output 'simple_stream': Total frames output: 196459
22:03:57.399: Output 'simple_stream': Total drawn frames: 154734 (196514 attempted)
22:03:57.399: Output 'simple_stream': Number of lagged frames due to rendering lag/stalls: 41780 (21.3%)
22:03:57.400: Video stopped, number of skipped frames due to encoding lag: 41780/196473 (21.3%)
Rendering lag of 21.3% -- GPU is overloaded. This means OBS isn't able to use the necessary GPU resources it needs to render the scene. The encoding lag is actually a byproduct of the rendering lag and can be ignored in this case -- one of the quirks of using Nvenc (new).
The easiest way to fix this is to cap your game's framerate. Considering this is LoL, that should be about all that's needed, especially on a 1060... BUT, if that doesn't fix things, then you can also try reducing in-game graphics settings, or playing at a lower resolution.
Something else you can try is switching your output mode to Advanced in OBS, and unchecking psychovisual tuning (the other settings can stay, just use the code above as reference... although you could probably bump the quality up to "high quality") -- this will ensure that the encoder isn't putting any more strain on the rest of the GPU. It doesn't mean OBS won't still need the GPU for rendering (it always will), but it will reduce the need for the encoder to add its own GPU load.
If none of that works still, then you can try this...
- Turn game mode
on in windows
- Run OBS in administrator mode
That should allow the new feature of 24.0.3 to kick in telling windows to add OBS to the GPU priority programs, but your mileage may vary.