Question / Help How to record smooth 1440p60 with nvenc?

212785

New Member
I've tried all kinds of different settings in OBS, but I always get video with duplicate frames (every 1/5 or so), which looks like stutters in playback.

When I record with shadowplay, I get perfectly smooth video with unique frames only. The only problem is that the highest quality/bitrate in shadowplay is pretty bad. (I still got duplicate frames in OBS when using the same shitty bitrate as in shadowplay.)

Anyone have any suggestions?
 

212785

New Member
Okay

Code:
19:58:11.017: CPU Name: Intel(R) Core(TM) i5-2500K CPU @ 3.30GHz
19:58:11.018: CPU Speed: 3292MHz
19:58:11.018: Physical Cores: 4, Logical Cores: 4
19:58:11.018: Physical Memory: 8109MB Total, 5102MB Free
19:58:11.018: Windows Version: 6.1 Build 7601 (revision: 23418; 64-bit)
19:58:11.018: Running as administrator: false
19:58:11.018: Aero is Disabled
19:58:11.020: Portable mode: false
19:58:11.045: OBS 18.0.1 (64bit, windows)
19:58:11.045: ---------------------------------
19:58:11.046: ---------------------------------
19:58:11.046: audio settings reset:
19:58:11.046:     samples per sec: 48000
19:58:11.046:     speakers:        2
19:58:11.071: ---------------------------------
19:58:11.071: Initializing D3D11..
19:58:11.071: Available Video Adapters:
19:58:11.078:     Adapter 1: NVIDIA GeForce GTX 980 Ti
19:58:11.078:       Dedicated VRAM: 2047541248
19:58:11.078:       Shared VRAM:    3983110144
19:58:11.078:       output 1: pos={0, 0}, size={2560, 1440}, attached=true
19:58:11.084: Loading up D3D11 on adapter NVIDIA GeForce GTX 980 Ti (0)
19:58:11.186: D3D11 loaded sucessfully, feature level used: 45056
19:58:12.847: ---------------------------------
19:58:12.847: video settings reset:
19:58:12.847:     base resolution:   2560x1440
19:58:12.847:     output resolution: 2560x1440
19:58:12.847:     downscale filter:  Bicubic
19:58:12.847:     fps:               60/1
19:58:12.847:     format:            NV12
19:58:12.848: Audio monitoring device:
19:58:12.848:     name: Default
19:58:12.848:     id: default
19:58:12.848: ---------------------------------
19:58:12.930: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/chrome_elf.dll' not found, loading of module failed
19:58:12.952: [CoreAudio encoder]: CoreAudio AAC encoder not installed on the system or couldn't be loaded
19:58:13.003: [AMF Encoder] Unable to load 'amfrt64.dll', error code 126.
19:58:13.305: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/libcef.dll' not found, loading of module failed
19:58:13.331: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/libEGL.dll' not found, loading of module failed
19:58:13.360: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/libGLESv2.dll' not found, loading of module failed
19:58:13.376: Failed to load 'en-US' text for module: 'obs-browser.dll'
19:58:13.376: [browser_source: 'Version: 1.29.0']
19:58:13.709: NVENC supported
19:58:14.538: Couldn't find VLC installation, VLC video source disabled
19:58:14.788: No blackmagic support
19:58:15.169: [Media Foundation encoder]: plugin is disabled for performance reasons on Windows versions prior to 8
19:58:15.292: ---------------------------------
19:58:15.292:   Loaded Modules:
19:58:15.292:     win-wasapi.dll
19:58:15.292:     win-mf.dll
19:58:15.292:     win-dshow.dll
19:58:15.292:     win-decklink.dll
19:58:15.292:     win-capture.dll
19:58:15.292:     vlc-video.dll
19:58:15.292:     text-freetype2.dll
19:58:15.292:     rtmp-services.dll
19:58:15.292:     obs-x264.dll
19:58:15.292:     obs-vst.dll
19:58:15.292:     obs-transitions.dll
19:58:15.292:     obs-text.dll
19:58:15.292:     obs-qsv11.dll
19:58:15.292:     obs-outputs.dll
19:58:15.292:     obs-filters.dll
19:58:15.292:     obs-ffmpeg.dll
19:58:15.292:     obs-browser.dll
19:58:15.292:     image-source.dll
19:58:15.292:     frontend-tools.dll
19:58:15.292:     enc-amf.dll
19:58:15.292:     coreaudio-encoder.dll
19:58:15.292: ==== Startup complete ===============================================
19:58:15.332: Service '' not found
19:58:15.389: All scene data cleared
19:58:15.389: ------------------------------------------------
19:58:15.616: WASAPI: Device 'Speakers (Realtek High Definition Audio)' initialized
19:58:15.645: WASAPI: Device 'Microphone (Realtek High Definition Audio)' initialized
19:58:15.724: adding 106 milliseconds of audio buffering, total audio buffering is now 106 milliseconds
19:58:16.112: Switched to scene 'Scene'
19:58:16.140: ------------------------------------------------
19:58:16.140: Loaded scenes:
19:58:16.140: - scene 'Scene':
19:58:16.140:     - source: 'Game Capture' (game_capture)
19:58:16.140: ------------------------------------------------
19:58:16.207: CalculateFileHash: Failed to open file 'C:\Users\l\AppData\Roaming\obs-studio\updates\manifest.json': 2
19:58:16.212: [rtmp-services plugin] Successfully updated file 'services.json' (version 59)
19:58:16.213: [rtmp-services plugin] Successfully updated package (version 59)
19:58:17.131: CalculateFileHash: Failed to open file 'C:\Users\l\AppData\Roaming\obs-studio\updates\updater.exe': 2
19:58:45.341: [game-capture: 'Game Capture'] attempting to hook process: witcher3.exe
19:58:45.342: [game-capture: 'Game Capture'] using helper (compatibility hook)
19:58:45.366: [game-capture: 'Game Capture'] hook not loaded yet, retrying..
19:58:48.357: [game-capture: 'Game Capture'] attempting to hook process: witcher3.exe
19:58:48.439: [game-capture: 'Game Capture'] d3d11 shared texture capture successful
19:58:48.441: [game-capture: 'Game Capture'] shared texture capture successful
19:59:41.896: rtmp-common.c: [initialize_output] Could not find service ''
19:59:41.908: ---------------------------------
19:59:41.949: [NVENC encoder: 'recording_h264'] settings:
19:59:41.949:     rate_control: CQP
19:59:41.949:     bitrate:      0
19:59:41.949:     cqp:          30
19:59:41.949:     keyint:       250
19:59:41.949:     preset:       default
19:59:41.949:     profile:      high
19:59:41.949:     level:        auto
19:59:41.949:     width:        2560
19:59:41.949:     height:       1440
19:59:41.949:     2-pass:       true
19:59:41.949:     b-frames:     2
19:59:41.949:     GPU:          0
19:59:41.949:
19:59:42.865: ---------------------------------
19:59:42.865: [FFmpeg aac encoder: 'Track1'] bitrate: 320, channels: 2
19:59:42.978: ==== Recording Start ===============================================
19:59:42.978: [ffmpeg muxer: 'adv_file_output'] Writing file 'E:/2017-05-30 19-59-41.mp4'...
20:00:03.333: [ffmpeg muxer: 'adv_file_output'] Output of file 'E:/2017-05-30 19-59-41.mp4' stopped
20:00:03.333: Output 'adv_file_output': stopping
20:00:03.333: Output 'adv_file_output': Total encoded frames: 1220
20:00:03.333: Output 'adv_file_output': Total drawn frames: 1221
20:00:03.333: ==== Recording Stop ================================================
 

DeMoN

Member
try 2 pass off and bframes 0
use the high performance preset

your cqp value is extremely high - I would assume high loss in quality with it?

I get good results with no bframes and no 2pass - like said - try it :)

I can capture a 2560x1600 @ 120 (!) fps video without duplicate frames with these settings with a GTX 1080
 

Boildown

Active Member
The biggest change to avoid the duplicated frames should be to change the preset. "Default" shouldn't be the default, really. Try High Performance (HP) and if that works, you might try pushing it up to High Quality (HQ).
 

212785

New Member
try 2 pass off and bframes 0
use the high performance preset

your cqp value is extremely high - I would assume high loss in quality with it?

I get good results with no bframes and no 2pass - like said - try it :)

I can capture a 2560x1600 @ 120 (!) fps video without duplicate frames with these settings with a GTX 1080

I tried these settings, but I'm still getting duplicate frames

Code:
21:16:54.300: CPU Name: Intel(R) Core(TM) i5-2500K CPU @ 3.30GHz
21:16:54.301: CPU Speed: 3292MHz
21:16:54.301: Physical Cores: 4, Logical Cores: 4
21:16:54.301: Physical Memory: 8109MB Total, 1425MB Free
21:16:54.301: Windows Version: 6.1 Build 7601 (revision: 23418; 64-bit)
21:16:54.301: Running as administrator: false
21:16:54.301: Aero is Disabled
21:16:54.301: Portable mode: false
21:16:54.313: OBS 18.0.1 (64bit, windows)
21:16:54.313: ---------------------------------
21:16:54.314: ---------------------------------
21:16:54.314: audio settings reset:
21:16:54.314:     samples per sec: 48000
21:16:54.314:     speakers:        2
21:16:54.328: ---------------------------------
21:16:54.328: Initializing D3D11..
21:16:54.328: Available Video Adapters:
21:16:54.334:     Adapter 1: NVIDIA GeForce GTX 980 Ti
21:16:54.334:       Dedicated VRAM: 2047541248
21:16:54.334:       Shared VRAM:    3983110144
21:16:54.334:       output 1: pos={0, 0}, size={2560, 1440}, attached=true
21:16:54.340: Loading up D3D11 on adapter NVIDIA GeForce GTX 980 Ti (0)
21:16:54.355: D3D11 loaded sucessfully, feature level used: 45056
21:16:56.117: ---------------------------------
21:16:56.117: video settings reset:
21:16:56.117:     base resolution:   2560x1440
21:16:56.117:     output resolution: 2560x1440
21:16:56.117:     downscale filter:  Bicubic
21:16:56.117:     fps:               60/1
21:16:56.117:     format:            NV12
21:16:56.119: Audio monitoring device:
21:16:56.119:     name: Default
21:16:56.119:     id: default
21:16:56.119: ---------------------------------
21:16:56.135: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/chrome_elf.dll' not found, loading of module failed
21:16:56.136: [CoreAudio encoder]: CoreAudio AAC encoder not installed on the system or couldn't be loaded
21:16:56.164: [AMF Encoder] Unable to load 'amfrt64.dll', error code 126.
21:16:56.255: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/libcef.dll' not found, loading of module failed
21:16:56.269: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/libEGL.dll' not found, loading of module failed
21:16:56.286: Required module function 'obs_module_load' in module '../../obs-plugins/64bit/libGLESv2.dll' not found, loading of module failed
21:16:56.293: Failed to load 'en-US' text for module: 'obs-browser.dll'
21:16:56.293: [browser_source: 'Version: 1.29.0']
21:16:56.304: NVENC supported
21:16:56.558: VLC found, VLC video source enabled
21:16:56.624: No blackmagic support
21:16:56.670: [Media Foundation encoder]: plugin is disabled for performance reasons on Windows versions prior to 8
21:16:56.682: ---------------------------------
21:16:56.682:   Loaded Modules:
21:16:56.682:     win-wasapi.dll
21:16:56.682:     win-mf.dll
21:16:56.682:     win-dshow.dll
21:16:56.682:     win-decklink.dll
21:16:56.682:     win-capture.dll
21:16:56.682:     vlc-video.dll
21:16:56.682:     text-freetype2.dll
21:16:56.682:     rtmp-services.dll
21:16:56.682:     obs-x264.dll
21:16:56.682:     obs-vst.dll
21:16:56.682:     obs-transitions.dll
21:16:56.682:     obs-text.dll
21:16:56.682:     obs-qsv11.dll
21:16:56.682:     obs-outputs.dll
21:16:56.682:     obs-filters.dll
21:16:56.682:     obs-ffmpeg.dll
21:16:56.682:     obs-browser.dll
21:16:56.682:     image-source.dll
21:16:56.682:     frontend-tools.dll
21:16:56.682:     enc-amf.dll
21:16:56.682:     coreaudio-encoder.dll
21:16:56.682: ==== Startup complete ===============================================
21:16:56.683: Service '' not found
21:16:56.684: All scene data cleared
21:16:56.684: ------------------------------------------------
21:16:56.750: WASAPI: Device 'Speakers (Realtek High Definition Audio)' initialized
21:16:56.766: WASAPI: Device 'Microphone (Realtek High Definition Audio)' initialized
21:16:56.789: adding 42 milliseconds of audio buffering, total audio buffering is now 42 milliseconds
21:16:57.277: Switched to scene 'Scene'
21:16:57.277: ------------------------------------------------
21:16:57.277: Loaded scenes:
21:16:57.277: - scene 'Scene':
21:16:57.278:     - source: 'Game Capture' (game_capture)
21:16:57.278: ------------------------------------------------
21:17:08.869: [game-capture: 'Game Capture'] attempting to hook fullscreen process: witcher3.exe
21:17:08.888: [game-capture: 'Game Capture'] shared texture capture successful
21:17:23.358: rtmp-common.c: [initialize_output] Could not find service ''
21:17:23.359: ---------------------------------
21:17:23.359: [NVENC encoder: 'recording_h264'] settings:
21:17:23.359:     rate_control: CQP
21:17:23.359:     bitrate:      0
21:17:23.359:     cqp:          20
21:17:23.359:     keyint:       250
21:17:23.359:     preset:       hp
21:17:23.359:     profile:      high
21:17:23.359:     level:        auto
21:17:23.359:     width:        2560
21:17:23.359:     height:       1440
21:17:23.359:     2-pass:       false
21:17:23.359:     b-frames:     0
21:17:23.359:     GPU:          0
21:17:23.359:
21:17:24.056: ---------------------------------
21:17:24.056: [FFmpeg aac encoder: 'Track1'] bitrate: 320, channels: 2
21:17:24.060: ==== Recording Start ===============================================
21:17:24.060: [ffmpeg muxer: 'adv_file_output'] Writing file 'E:/2017-05-31 21-17-23.mp4'...
21:17:33.913: [ffmpeg muxer: 'adv_file_output'] Output of file 'E:/2017-05-31 21-17-23.mp4' stopped
21:17:33.913: Output 'adv_file_output': stopping
21:17:33.913: Output 'adv_file_output': Total encoded frames: 585
21:17:33.913: Output 'adv_file_output': Total drawn frames: 591
21:17:33.913: ==== Recording Stop ================================================
21:17:42.240: ==== Shutting down ==================================================
21:17:42.242: Switched to scene '(null)'
21:17:42.242: [game-capture: 'Game Capture'] capture stopped
21:17:42.242: WASAPI: Device 'Speakers (Realtek High Definition Audio)' Terminated
21:17:42.260: WASAPI: Device 'Microphone (Realtek High Definition Audio)' Terminated
21:17:42.262: All scene data cleared
21:17:42.262: ------------------------------------------------
21:17:42.393: Freeing OBS context data
21:17:42.451: == Profiler Results =============================
21:17:42.451: run_program_init: 3146.65 ms
21:17:42.451:  ┣OBSApp::AppInit: 15.43 ms
21:17:42.451:  ┃ ┗OBSApp::InitLocale: 14.836 ms
21:17:42.451:  ┗OBSApp::OBSInit: 3124.54 ms
21:17:42.451:    ┣obs_startup: 1.254 ms
21:17:42.451:    ┗OBSBasic::OBSInit: 3060.99 ms
21:17:42.451:      ┣OBSBasic::InitBasicConfig: 0.372 ms
21:17:42.451:      ┣OBSBasic::ResetAudio: 0.206 ms
21:17:42.451:      ┣OBSBasic::ResetVideo: 1804.86 ms
21:17:42.451:      ┣OBSBasic::InitOBSCallbacks: 0.005 ms
21:17:42.451:      ┣OBSBasic::InitHotkeys: 0.04 ms
21:17:42.451:      ┣obs_load_all_modules: 563.544 ms
21:17:42.451:      ┃ ┣obs_init_module(coreaudio-encoder.dll): 0.495 ms
21:17:42.451:      ┃ ┣obs_init_module(enc-amf.dll): 0.29 ms
21:17:42.451:      ┃ ┣obs_init_module(frontend-tools.dll): 2.341 ms
21:17:42.451:      ┃ ┣obs_init_module(image-source.dll): 0.004 ms
21:17:42.451:      ┃ ┣obs_init_module(obs-browser.dll): 0.143 ms
21:17:42.451:      ┃ ┣obs_init_module(obs-ffmpeg.dll): 0.682 ms
21:17:42.451:      ┃ ┣obs_init_module(obs-filters.dll): 0.01 ms
21:17:42.451:      ┃ ┣obs_init_module(obs-outputs.dll): 0.006 ms
21:17:42.451:      ┃ ┣obs_init_module(obs-qsv11.dll): 68.337 ms
21:17:42.451:      ┃ ┣obs_init_module(obs-text.dll): 0.391 ms
21:17:42.451:      ┃ ┣obs_init_module(obs-transitions.dll): 0.006 ms
21:17:42.451:      ┃ ┣obs_init_module(obs-vst.dll): 0.002 ms
21:17:42.451:      ┃ ┣obs_init_module(obs-x264.dll): 0.002 ms
21:17:42.451:      ┃ ┣obs_init_module(rtmp-services.dll): 0.377 ms
21:17:42.451:      ┃ ┣obs_init_module(text-freetype2.dll): 0.053 ms
21:17:42.451:      ┃ ┣obs_init_module(vlc-video.dll): 36.699 ms
21:17:42.451:      ┃ ┣obs_init_module(win-capture.dll): 0.141 ms
21:17:42.451:      ┃ ┣obs_init_module(win-decklink.dll): 14.12 ms
21:17:42.451:      ┃ ┣obs_init_module(win-dshow.dll): 3.523 ms
21:17:42.451:      ┃ ┣obs_init_module(win-mf.dll): 1.773 ms
21:17:42.451:      ┃ ┣obs_init_module(win-wasapi.dll): 0.005 ms
21:17:42.451:      ┃ ┗reset_win32_symbol_paths: 0.121 ms
21:17:42.451:      ┣OBSBasic::ResetOutputs: 0.42 ms
21:17:42.452:      ┣OBSBasic::CreateHotkeys: 0.221 ms
21:17:42.452:      ┣OBSBasic::InitService: 0.089 ms
21:17:42.452:      ┣OBSBasic::InitPrimitives: 0.541 ms
21:17:42.452:      ┗OBSBasic::Load: 593.892 ms
21:17:42.452: obs_hotkey_thread(25 ms): min=0.002 ms, median=0.005 ms, max=44.729 ms, 99th percentile=2.125 ms, 99.7867% below 25 ms
21:17:42.452: audio_thread(Audio): min=0 ms, median=0.073 ms, max=97.59 ms, 99th percentile=4.449 ms
21:17:42.452:  ┗receive_audio: min=0.012 ms, median=1.073 ms, max=97.527 ms, 99th percentile=10.002 ms, 0.205845 calls per parent call
21:17:42.452:    ┣buffer_audio: min=0.001 ms, median=0.002 ms, max=0.019 ms, 99th percentile=0.006 ms
21:17:42.452:    ┗do_encode: min=0.03 ms, median=1.078 ms, max=97.521 ms, 99th percentile=9.996 ms
21:17:42.452:      ┗encode(Track1): min=0.025 ms, median=0.764 ms, max=10.163 ms, 99th percentile=8.45 ms
21:17:42.452: obs_video_thread(16.6667 ms): min=0.233 ms, median=1.823 ms, max=510.025 ms, 99th percentile=26.652 ms, 98.2708% below 16.667 ms
21:17:42.452:  ┣tick_sources: min=0.001 ms, median=0.015 ms, max=508.68 ms, 99th percentile=1.614 ms
21:17:42.452:  ┣render_displays: min=0.001 ms, median=0.394 ms, max=93.183 ms, 99th percentile=4.261 ms
21:17:42.452:  ┗output_frame: min=0.227 ms, median=1.358 ms, max=54.214 ms, 99th percentile=21.979 ms
21:17:42.452:    ┣gs_context(video->graphics): min=0.089 ms, median=0.157 ms, max=53.325 ms, 99th percentile=20.295 ms
21:17:42.452:    ┃ ┣render_video: min=0.023 ms, median=0.041 ms, max=9.798 ms, 99th percentile=0.315 ms
21:17:42.452:    ┃ ┃ ┣render_main_texture: min=0.004 ms, median=0.016 ms, max=9.688 ms, 99th percentile=0.087 ms
21:17:42.452:    ┃ ┃ ┣render_output_texture: min=0.002 ms, median=0.008 ms, max=1.041 ms, 99th percentile=0.05 ms
21:17:42.452:    ┃ ┃ ┣render_convert_texture: min=0.001 ms, median=0.01 ms, max=2.63 ms, 99th percentile=0.041 ms
21:17:42.452:    ┃ ┃ ┗stage_output_texture: min=0 ms, median=0.002 ms, max=3.602 ms, 99th percentile=0.076 ms
21:17:42.452:    ┃ ┣download_frame: min=0 ms, median=0.002 ms, max=53.104 ms, 99th percentile=19.656 ms
21:17:42.452:    ┃ ┗gs_flush: min=0.035 ms, median=0.101 ms, max=43.829 ms, 99th percentile=2.037 ms
21:17:42.452:    ┗output_video_data: min=0.839 ms, median=1.137 ms, max=5.92 ms, 99th percentile=2.93 ms
21:17:42.452: video_thread(video): min=0 ms, median=0.002 ms, max=92.96 ms, 99th percentile=6.609 ms
21:17:42.452:  ┗receive_video: min=0.001 ms, median=4.369 ms, max=92.955 ms, 99th percentile=15.073 ms, 0.217103 calls per parent call
21:17:42.452:    ┗do_encode: min=2.31 ms, median=4.368 ms, max=92.954 ms, 99th percentile=15.071 ms
21:17:42.452:      ┗encode(recording_h264): min=2.267 ms, median=3.774 ms, max=15.401 ms, 99th percentile=6.266 ms
21:17:42.452: =================================================
21:17:42.452: == Profiler Time Between Calls ==================
21:17:42.452: obs_hotkey_thread(25 ms): min=24.028 ms, median=25.002 ms, max=702.444 ms, 85.1121% within ±2% of 25 ms (3.84205% lower, 11.0459% higher)
21:17:42.452: obs_video_thread(16.6667 ms): min=4.345 ms, median=16.667 ms, max=510.032 ms, 84.7994% within ±2% of 16.667 ms (7.72911% lower, 7.47148% higher)
21:17:42.452: =================================================
21:17:42.509: Number of memory leaks: 1
 

Boildown

Active Member
Update to the latest version and make your tests at least 5 minutes long and of high action content.
 
Top