Question / Help Recording Premiere w/ NVENC

EposVox

EposVox

Member
Has anyone found a workaround for recording Adobe Premiere Pro w/ NVENC?
From what I've gathered, Adobe themselves somehow broke this with one of the CC 2017 updates. (I've recorded Premiere just fine w/ Nvenc from probably ~2014 up til earlier this year when it stopped working.) Something to do with the way it hooks CUDA now just won't let Nvenc happen.

But what's strange is that it's still happening in my setup. I've installed a dedicated Quadro graphics card for running Nvenc encoding. Set OBS to just use that GPU for it, and set rules for every Adobe-related EXE (went through all of them in the PPro, AE, AME folders that I could find) within the Nvidia Control Panel to only use my main GPU for CUDA and not the Quadro.
Still get the same error with this in the log:

20:14:51.847: error: OpenEncodeSessionEx failed: out of memory (10)
20:14:51.866: fatal: No NVENC capable devices found
20:14:51.866: [NVENC encoder: 'recording_h264'] Failed to open NVENC codec: Generic error in an external library​

Even if I've recorded w/ Nvenc in the same OBS session, suddenly it thinks there's no Nvenc devices. It's really strange and quite disruptive to my work, was hoping someone found a workaround or something I've missed.
If only Adobe would give us a manual GPU selection in the program or something...

(No, Premiere is not "using too much of your GPU" or "using too much VRAM" etc.)

Also worth noting that setting a Global Rule to only use CUDA on the main GPU results in Nvenc not working at all, since the two are related. So I have to leave the Global Rule set to "All".

System Specs:
  • Windows 10 Home 64-bit
  • OBS Studio 64-bit 19.0.3
  • Nvidia GTX 1080 (latest stable drivers)
  • Nvidia Quadro P400
  • Adobe Premiere Pro/AE/AME CC 2017 (latest updates)
  • CPU: i7-6900K (no Quick Sync)
((I've also started an Adobe Forum thread per their Twitter support so we can tackle this from all angles.))
 
Last edited:
EposVox

EposVox

Member
Sapiens said:
Any reason you can't use something like QSV instead of NVENC?
Click to expand...
Isn't supported on my 6900k. X264 is a little too heavy to balance with the intense editing workloads, too. I use Nvenc for literally everything; kind of important to my workflow. Just not sure why it randomly stopped working w/ Premiere earlier this year.
 
EposVox

EposVox

Member
Bumping with an update -- Just confirmed that XSplit seems to have no problem recording with Nvenc while Premiere is open (nor does Shadowplay when it actually wants to cooperate), so this narrows to more of an OBS issue IMO.

Adobe team is supposedly having someone look at a thread I posted with them; but not likely to get a helpful response.
 
Last edited:
Fenrir

Fenrir

Forum Admin
OBS uses NVENC through ffmpeg, so there's not a whole lot we can do. FFmpeg is on the list of dependencies that will be updated soon, but I can't tell you exactly when that will be.

In the meantime, make sure that OBS can see the quadro (check the log) and that it's set to use the proper GPU number in the encoding settings. By default, OBS will use the GPU that your primary monitor is on.
 
EposVox

EposVox

Member
Fenrir said:
OBS uses NVENC through ffmpeg, so there's not a whole lot we can do. FFmpeg is on the list of dependencies that will be updated soon, but I can't tell you exactly when that will be.

In the meantime, make sure that OBS can see the quadro (check the log) and that it's set to use the proper GPU number in the encoding settings. By default, OBS will use the GPU that your primary monitor is on.
Click to expand...
Yeah before I even tried Premiere-specific stuff, made sure the Quadro worked. Quadro is detected (GPU 1) and it works beautifully (can see usage in GPU-Z) normally. Just not with Premiere.

Potentially dumb question: Is there anything I can do to manually update the ffmpeg dependency files, per se? (I'm guessing it doesn't work that way)
 
Fenrir

Fenrir

Forum Admin
Actually, it does. You can just download the binaries (or compile them yourself) and replace the ones in the OBS program directory.

Edit: Official source for precompiled: http://ffmpeg.zeranoe.com/builds/

Edit2: You want the "Shared" linking download that has the .dll files
 
EposVox

EposVox

Member
Fenrir said:
Actually, it does. You can just download the binaries (or compile them yourself) and replace the ones in the OBS program directory.
Click to expand...
Oh sweet, I'll give that a go and see if maybe it works with a newer release of FFMPEG. Probably not, but I will try anything to get this working again. Dunno what happened but this stopped working w/ the 18.0-ish update :/ (Which I was told did nothing to these libraries, so IDFK haha)
 
EposVox

EposVox

Member
Lol RIP.
Downloaded the DLLs and replaced in C:\Program Files (x86)\obs-studio\bin\64bit
(got 64-bit copy of ffmpeg for sure)

And it crashes whenever I try to hit start recording now with Premiere open. Seems to be working fine with normal desktop use. (edit)

Copied log:

Unhandled exception: c0000005
Date/Time: 2017-08-09, 18:20:43
Fault address: 7FFCC982F7FB (c:\windows\system32\ntdll.dll)
libobs version: 19.0.3
Windows version: 10.0 build 14393 (revision: 1198; 64-bit)
CPU: Intel(R) Core(TM) i7-6900K CPU @ 3.20GHz

Here's the rest: https://pastebin.com/sDwLum0K

Guess I'll just switch back for now.
 
Fenrir

Fenrir

Forum Admin
The memory leak is irrelevant, and not exactly what you think it is.

As for the "Out of memory" they're talking about the GPU itself, not your system. Check that the VRAM on the GPU itself is not fully maxed out with a tool like GPUz or something similar.
 
EposVox

EposVox

Member
Fenrir said:
The memory leak is irrelevant, and not exactly what you think it is.

As for the "Out of memory" they're talking about the GPU itself, not your system. Check that the VRAM on the GPU itself is not fully maxed out with a tool like GPUz or something similar.
Click to expand...
Gotcha.

Nah, half of the GTX 1080's (compositing GPU) RAM is still available (~4GB of 8 used) and 75%+ of the Quadro (Nvenc GPU) memory available, and memory controller load at 4% on both.
 
Fenrir

Fenrir

Forum Admin
Very, very bizarre to say the least. For what it's worth, we just had someone else through the chat with the exact same issue. I'd say Premiere just broke some stuff in a recent update if I was a betting man.
 
EposVox

EposVox

Member
Fenrir said:
Very, very bizarre to say the least. For what it's worth, we just had someone else through the chat with the exact same issue. I'd say Premiere just broke some stuff in a recent update if I was a betting man.
Click to expand...
Fun. They're supposedly looking at my thread on Adobe forums, but no response thus far. Very annoying that GeForce Experience and XSplit seem to be OK doing it, but I need OBS-specific features lol.

What also bugs me is the "No NVENC devices found" thing once CUDA is going. That's... not at all right. And I have no working way to limit Premiere to 1 GPU. (Or if I was still on 1 GPU only that'd be it)
 
Dark Archon

Dark Archon

New Member
Hi, it's probably no help to you, but I just wanted to confirm that I am having the exact same issue with using OBS with NVENC while Premiere is on. The problem persists in the latest 20.0.0 version of the software.
 
EposVox

EposVox

Member
UPDATE TIME! Sorta. Workaround, but has me even MORE confused as to what is happening.

Steps
  • Open OBS. (Usual Nvenc 2 GPU layout)
  • Start recording
  • Open Premiere, load project.
  • Project seems to struggle to load any video previews until I hit "Stop Recording" (but recording seems otherwise unaffected)
  • Previews load, hit "Start Recording" again
  • Still seems to record just fine, no errors.
  • (Closing and re-opening OBS, or just doing all this without having a recording going before Premiere open still results in the usual error)
So this is sort of a workaround? But not a complete solution by any stretch and I'm still looking for a complete solution, but maybe this piece to the puzzle can contribute to an overall solution eventually?

Here's the log. But I can't find any useful information. :/
 
You must log in or register to reply here.
Top