I had this issue like a week ago but updating my drivers fixed it. It happened again, so i updated them, but it didnt help. Heres the log line if anyone can tell me plz how to fix it im so confused.
error: OpenEncodeSessionEx failed: out of memory (10)
17:25:29.842: fatal: No NVENC capable devices found
17:25:29.842: [NVENC encoder: 'recording_h264'] Failed to open NVENC codec: Generic error in an external library
error: OpenEncodeSessionEx failed: out of memory (10)
17:25:29.842: fatal: No NVENC capable devices found
17:25:29.842: [NVENC encoder: 'recording_h264'] Failed to open NVENC codec: Generic error in an external library