Question / Help Constantly Getting "Encoder Overloaded" Error Since Switching Graphics Cards.

avrona

Member
So I've recently updated from an R9 280x to a 1080 Ti, and ever since then I've been getting a "Encoder Overloaded" error, along with OBS Studio taking a very long time to stop recording after I press stop recording. I'm guessing it's some setting I have to change for my new graphics card, but I don't really know too much about that kind of thing, so if anyone knows what to do it would be really appreciated.
 

Narcogen

Active Member
If you were, you'd know-- you'd have to manually select NVENC as the encoder.

If you're not using NVENC, then you're likely using x264 being done by your CPU, and the overload message means your CPU cannot handle the load of both running whatever it is you're capturing and encoding the stream.

If what you did after upgrading was decide that you could, say, go from recording 720p30 to recording 1080p60, you may have overdone it.

To be more specific I'd have to see a log containing a recording session where you experience the problem.

Please post a log with your issue! Here's how...
 

avrona

Member
If you were, you'd know-- you'd have to manually select NVENC as the encoder.

If you're not using NVENC, then you're likely using x264 being done by your CPU, and the overload message means your CPU cannot handle the load of both running whatever it is you're capturing and encoding the stream.

If what you did after upgrading was decide that you could, say, go from recording 720p30 to recording 1080p60, you may have overdone it.

To be more specific I'd have to see a log containing a recording session where you experience the problem.

Please post a log with your issue! Here's how...

So I've changed to NVENC and the issue persisted. I've tried using the upload last log feature but it didn't work.
 

Narcogen

Active Member
Then use the Help > Log Files > Show Log Files option to grab your last log manually and put it up on hastebin or pastebin or something.
 

avrona

Member
Then use the Help > Log Files > Show Log Files option to grab your last log manually and put it up on hastebin or pastebin or something.
16:14:35.620: CPU Name: AMD FX(tm)-8350 Eight-Core Processor
16:14:35.620: CPU Speed: 4013MHz
16:14:35.620: Physical Cores: 4, Logical Cores: 8
16:14:35.620: Physical Memory: 16283MB Total, 10926MB Free
16:14:35.620: Windows Version: 10.0 Build 17134 (revision: 471; 64-bit)
16:14:35.620: Running as administrator: true
16:14:35.620: Aero is Enabled (Aero is always on for windows 8 and above)
16:14:35.620: Windows 10 Gaming Features:
16:14:35.620: Game Bar: On
16:14:35.620: Game DVR: On
16:14:35.620: Game DVR Background Recording: Off
16:14:35.622: Sec. Software Status:
16:14:35.624: Windows Defender Antivirus: disabled (AV)
16:14:35.624: Windows Firewall: enabled (FW)
16:14:35.624: Windows Defender Antivirus: disabled (ASW)
16:14:35.625: Portable mode: false
16:14:35.801: OBS 21.1.0 (64bit, windows)
16:14:35.801: ---------------------------------
16:14:35.816: ---------------------------------
16:14:35.816: audio settings reset:
16:14:35.816: samples per sec: 48000
16:14:35.816: speakers: 1
16:14:35.818: ---------------------------------
16:14:35.818: Initializing D3D11...
16:14:35.818: Available Video Adapters:
16:14:35.819: Adapter 1: NVIDIA GeForce GTX 1080 Ti
16:14:35.819: Dedicated VRAM: 3077570560
16:14:35.819: Shared VRAM: 4242278400
16:14:35.819: output 1: pos={0, 0}, size={3840, 2160}, attached=true
16:14:35.823: Loading up D3D11 on adapter NVIDIA GeForce GTX 1080 Ti (0)
16:14:35.910: D3D11 loaded successfully, feature level used: 45056
16:14:36.822: ---------------------------------
16:14:36.822: video settings reset:
16:14:36.822: base resolution: 3840x2160
16:14:36.822: output resolution: 3840x2160
16:14:36.822: downscale filter: Bicubic
16:14:36.822: fps: 60/1
16:14:36.822: format: NV12
16:14:36.822: YUV mode: 601/Partial
16:14:36.825: Audio monitoring device:
16:14:36.825: name: Default
16:14:36.825: id: default
16:14:36.826: ---------------------------------
16:14:36.829: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/chrome_elf.dll' not found, loading of module failed
16:14:36.831: [CoreAudio encoder]: CoreAudio AAC encoder not installed on the system or couldn't be loaded
16:14:36.952: [AMF] Version 2.3.3 loaded (Compiled: 1.4.4.0, Runtime: 1.4.7.0, Library: 1;4;7;0;18.10.01.05;201804242340;CL#1544644).
16:14:36.974: [AMF] [H264/AVC] Not supported by any GPU, disabling...
16:14:36.974: [AMF] [H265/HEVC] Not supported by any GPU, disabling...
16:14:36.988: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/libcef.dll' not found, loading of module failed
16:14:36.988: LoadLibrary failed for '../../obs-plugins/64bit/libEGL.dll': The specified procedure could not be found.
16:14:36.988: (127)
16:14:36.988: Module '../../obs-plugins/64bit/libEGL.dll' not loaded
16:14:36.989: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/libGLESv2.dll' not found, loading of module failed
16:14:36.990: [browser_source: 'Version: 1.31.0']
16:14:36.996: NVENC supported
16:14:37.048: Couldn't find VLC installation, VLC video source disabled
16:14:37.050: No blackmagic support
16:14:37.054: ---------------------------------
16:14:37.054: Loaded Modules:
16:14:37.054: win-wasapi.dll
16:14:37.054: win-mf.dll
16:14:37.054: win-dshow.dll
16:14:37.054: win-decklink.dll
16:14:37.054: win-capture.dll
16:14:37.054: vlc-video.dll
16:14:37.054: text-freetype2.dll
16:14:37.054: rtmp-services.dll
16:14:37.054: obs-x264.dll
16:14:37.054: obs-vst.dll
16:14:37.054: obs-transitions.dll
16:14:37.054: obs-text.dll
16:14:37.054: obs-qsv11.dll
16:14:37.054: obs-outputs.dll
16:14:37.054: obs-filters.dll
16:14:37.054: obs-ffmpeg.dll
16:14:37.054: obs-browser.dll
16:14:37.054: image-source.dll
16:14:37.054: frontend-tools.dll
16:14:37.054: enc-amf.dll
16:14:37.054: coreaudio-encoder.dll
16:14:37.054: boom-capture.dll
16:14:37.054: ---------------------------------
16:14:37.054: ==== Startup complete ===============================================
16:14:37.062: All scene data cleared
16:14:37.062: ------------------------------------------------
16:14:37.146: WASAPI: Device 'Speakers (Sound Blaster Z)' initialized
16:14:37.197: WASAPI: Device 'Microphone (High Definition Audio Device)' initialized
16:14:37.228: WASAPI: Device 'Microphone (High Definition Audio Device)' initialized
16:14:37.244: adding 42 milliseconds of audio buffering, total audio buffering is now 42 milliseconds
16:14:37.335: [WASAPISource::WASAPISource] Device '{0.0.1.00000000}.{2ef12a90-45eb-46b1-9192-177cba7fe6cc}' not found. Waiting for device
16:14:37.363: ---------------------------------
16:14:37.363: [DShow Device: 'Video Capture Device 2'] settings updated:
16:14:37.363: video device: Logitech HD Webcam C270
16:14:37.363: video path: \\?\usb#vid_046d&pid_0825&mi_00#6&3a1f7254&0&0000#{65e8773d-8f56-11d0-a3b9-00a0c9223196}\{bbefb6c7-2fc4-4139-bb8b-a58bba724083}
16:14:37.363: resolution: 640x480
16:14:37.363: fps: 30.00 (interval: 333333)
16:14:37.363: format: I420
16:14:37.775: [Media Source 'Sigma Music']: settings:
16:14:37.775: input: C:/Users/Adam/Downloads/Stellaris Soundtrack - Sigma Tauri.mp3
16:14:37.775: input_format: (null)
16:14:37.775: speed: 100
16:14:37.775: is_looping: yes
16:14:37.775: is_hw_decoding: yes
16:14:37.775: is_clear_on_media_end: yes
16:14:37.775: restart_on_activate: yes
16:14:37.775: close_when_inactive: no
16:14:37.779: warning: Could not update timestamps for skipped samples.
16:14:37.841: webcam: ResolutionValid failed
16:14:37.841: webcam: Video configuration failed
16:14:37.865: Video Capture Device: data.GetDevice failed
16:14:37.865: Video Capture Device: Video configuration failed
16:14:37.885: ---------------------------------
16:14:37.885: [DShow Device: 'Video Capture Device 3'] settings updated:
16:14:37.885: video device: Logitech HD Webcam C270
16:14:37.885: video path: \\?\usb#vid_046d&pid_0825&mi_00#6&3a1f7254&0&0000#{65e8773d-8f56-11d0-a3b9-00a0c9223196}\{bbefb6c7-2fc4-4139-bb8b-a58bba724083}
16:14:37.885: resolution: 640x480
16:14:37.885: fps: 30.00 (interval: 333333)
16:14:37.885: format: I420
16:14:37.919: Switched to scene 'Scene'
16:14:37.919: ------------------------------------------------
16:14:37.919: Loaded scenes:
16:14:37.919: - scene 'Scene':
16:14:37.919: - source: 'Display Capture' (monitor_capture)
16:14:37.919: - filter: 'Crop/Pad' (crop_filter)
16:14:37.919: - source: 'Game Capture' (game_capture)
16:14:37.919: - filter: 'Crop/Pad' (crop_filter)
16:14:37.919: - source: 'Image 2' (image_source)
16:14:37.919: - source: 'Video Capture Device 3' (dshow_input)
16:14:37.919: - filter: 'Color Correction' (color_filter)
16:14:37.919: - filter: 'Sharpen' (sharpness_filter)
16:14:37.919: - filter: 'Apply LUT' (clut_filter)
16:14:37.919: - filter: 'Color Key' (color_key_filter)
16:14:37.919: - filter: 'VST 2.x Plug-in' (vst_filter)
16:14:37.919: - scene 'Minecon Earth':
16:14:37.919: - source: 'Audio Input Capture' (wasapi_input_capture)
16:14:37.919: - scene 'PTCG':
16:14:37.919: - source: 'Video Capture Device 2' (dshow_input)
16:14:37.920: - filter: 'Color Correction' (color_filter)
16:14:37.920: - filter: 'Crop/Pad' (crop_filter)
16:14:37.920: - scene 'Pokemon LP':
16:14:37.920: - source: 'Display Capture' (monitor_capture)
16:14:37.920: - filter: 'Crop/Pad' (crop_filter)
16:14:37.920: - source: 'Game Capture' (game_capture)
16:14:37.920: - filter: 'Crop/Pad' (crop_filter)
16:14:37.920: - source: 'Sigma Music' (ffmpeg_source)
16:14:37.920: - source: 'Alerts' (browser_source)
16:14:37.920: - source: 'View Count' (browser_source)
16:14:37.920: - source: 'team1' (image_source)
16:14:37.920: - source: 'team2' (image_source)
16:14:37.920: - source: 'team3' (image_source)
16:14:37.920: - source: 'team5' (image_source)
16:14:37.920: - source: 'team4' (image_source)
16:14:37.920: - source: 'team6' (image_source)
16:14:37.920: - source: 'webcam' (dshow_input)
16:14:37.920: - filter: 'Color Correction' (color_filter)
16:14:37.920: - filter: 'Chroma Key' (chroma_key_filter)
16:14:37.920: - source: 'Image 2' (image_source)
16:14:37.920: - source: 'Video Capture Device' (dshow_input)
16:14:37.920: - scene 'Livestream':
16:14:37.920: - source: 'Display Capture' (monitor_capture)
16:14:37.920: - filter: 'Crop/Pad' (crop_filter)
16:14:37.920: - source: 'Game Capture' (game_capture)
16:14:37.920: - filter: 'Crop/Pad' (crop_filter)
16:14:37.920: - source: 'Sigma Music' (ffmpeg_source)
16:14:37.920: - source: 'Alerts' (browser_source)
16:14:37.920: - source: 'View Count' (browser_source)
16:14:37.920: - source: 'webcam' (dshow_input)
16:14:37.920: - filter: 'Color Correction' (color_filter)
16:14:37.920: - filter: 'Chroma Key' (chroma_key_filter)
16:14:37.920: ------------------------------------------------
16:14:38.315: DShow: Run failed, device already in use (0x8007001F): A device attached to the system is not functioning.
16:14:38.315:
 

Narcogen

Active Member
Log needs to have a completed session in it. That log ends with startup. You need to open the app, start recording, observe your issue, stop recording, then grab the log. The relevant entries in the log are only written when recording or streaming stops.

Also, please post to hastebin or pastebin and put in the link, logs can be very long, please don't post directly into the forum.

That said:

Your version of OBS is not the latest, and the build you have has a broken auto-updater. I would download the latest directly from the site. The latest is 22.0.2.

Your Game Bar / Game DVR features are on. This can impede performance and should be turned off when using OBS:

16:14:35.620: Windows 10 Gaming Features:
16:14:35.620: Game Bar: On
16:14:35.620: Game DVR: On

Instructions on how to do so are here:

https://www.windowscentral.com/how-disable-and-remove-game-bar-windows-10-creators-update

You are trying to record 4k60. This is a tall order. If you get the "encoder overloaded" error while doing this with NVENC, then I think your only option if you want to use that encoder is either reduce framerate or resolution.

If you want to try the CPU encoding you may be able to do so, but in that case you will probably have to select the veryfast encoding preset or faster in order to eliminate the overload, and quality may suffer.
 

avrona

Member
Log needs to have a completed session in it. That log ends with startup. You need to open the app, start recording, observe your issue, stop recording, then grab the log. The relevant entries in the log are only written when recording or streaming stops.
And that's what I did, I opened up OBS and started recording, the overloading error came up almost immediately, I let it run for a few more seconds, and then turned it off. The log I posted was a log from that.

I've updated to the latest version, but the issue still persists, here's the new log: https://www.mediafire.com/file/1pdi0ungswt87w2/2018-12-15_16-28-38.txt/file
 

Narcogen

Active Member
16:29:41.122: Output 'adv_file_output': Number of lagged frames due to rendering lag/stalls: 96 (10.6%)
16:29:41.123: ==== Recording Stop ================================================
16:29:41.196: Video stopped, number of skipped frames due to encoding lag: 673/838 (80.3%)

You are overloading both your GPU and your encoder. You need to reduce framesize/framerate in your application in order to give OBS access to GPU resources to render frames prior to encoding.

Your encoding settings:

16:29:26.032: [x264 encoder: 'recording_h264'] preset: veryfast
16:29:26.032: [x264 encoder: 'recording_h264'] settings:
16:29:26.032: rate_control: CBR
16:29:26.032: bitrate: 2500
16:29:26.032: buffer size: 2500
16:29:26.032: crf: 0
16:29:26.032: fps_num: 60
16:29:26.032: fps_den: 1
16:29:26.032: width: 3840
16:29:26.032: height: 2160
16:29:26.032: keyint: 250

I suggest running the auto-configuration wizard in the Tools menu. You've got a ridiculously low bitrate set for your encoder compared to the frame size and frame rate you've set. You cannot possibly get a viewable recording in reasonable quality at 4k60 with a bitrate of 2500.

2500 is low even for a streaming bitrate, it would be appropriate only for 720p30. In general you don't really want to be using CBR rate control for recording, it's more appropriate for streaming.
 

avrona

Member
16:29:41.122: Output 'adv_file_output': Number of lagged frames due to rendering lag/stalls: 96 (10.6%)
16:29:41.123: ==== Recording Stop ================================================
16:29:41.196: Video stopped, number of skipped frames due to encoding lag: 673/838 (80.3%)

You are overloading both your GPU and your encoder. You need to reduce framesize/framerate in your application in order to give OBS access to GPU resources to render frames prior to encoding.

Your encoding settings:

16:29:26.032: [x264 encoder: 'recording_h264'] preset: veryfast
16:29:26.032: [x264 encoder: 'recording_h264'] settings:
16:29:26.032: rate_control: CBR
16:29:26.032: bitrate: 2500
16:29:26.032: buffer size: 2500
16:29:26.032: crf: 0
16:29:26.032: fps_num: 60
16:29:26.032: fps_den: 1
16:29:26.032: width: 3840
16:29:26.032: height: 2160
16:29:26.032: keyint: 250

I suggest running the auto-configuration wizard in the Tools menu. You've got a ridiculously low bitrate set for your encoder compared to the frame size and frame rate you've set. You cannot possibly get a viewable recording in reasonable quality at 4k60 with a bitrate of 2500.

2500 is low even for a streaming bitrate, it would be appropriate only for 720p30. In general you don't really want to be using CBR rate control for recording, it's more appropriate for streaming.
So I ran the wizard and that seemed to have solved the problem.
 

avrona

Member
Thanks so much for helping me fix the issue. I was kinda confused at first why all of a sudden getting a way better graphics card made OBS worse at its job.
 
Top