With
21:37:43.425: video settings reset:
21:37:43.425: base resolution: 1920x1080
21:37:43.425: output resolution: 1920x1080
21:37:43.425: downscale filter: Lanczos
21:37:43.425: fps: 60/1
21:37:43.425: format: NV12
21:37:43.425: YUV mode: 709/Full
what are you doing for hardware resource utilization real-time monitoring? I'm suspecting your computer is overloaded trying to do 709/Full. Why are you not doing Partial?
Then you have Window, Game, and Display Capture all in one scene (read up in this forum on why NOT to do that)
Basically, you've tweaked the settings, apparently without knowing the implications of those changes. So... go back to auto settings for Recording (or remove all of your tweaks), and try again.
and maybe read this thread
https://obsproject.com/forum/threads/best-settings.140188/
and then some additional notes I've captured
Jun 9 2021
NVENC. Tools > Auto-Configuration Wizard
Look-ahead allows the encoder to dynamically select the number of B-Frames, between 0 and the number of B-Frames you specify. B-frames are great because they increase image quality, but they consume a lot of your available bitrate (you should use CQP for recording so bitrate is not an issue), so they reduce quality on high motion content. Look-ahead enables the best of both worlds. This feature is CUDA accelerated; toggle this off if your GPU utilization is high to ensure a smooth recording.
Psycho Visual Tuning enables the Rate Distortion Optimization in the encoder, which greatly optimizes the way you use bitrate (not sure exactly how this works with CQP, possibly same quality at lower bitrate), improving image quality on movement. This feature is also CUDA accelerated.
If you're using something that uses the GPU, such as games, don't enable those. It depends on your source.