Encoder Error: nvenc error encode api internal error nv_enc_err_invalid_param

[Zellstice]

I'm having this error happen a lot lately, it's not every stream and I thought I had fixed the issue (depreciated encoder with the latest OBS update) but it's happened again today (after I'd been live for a few hours) and it's driving me up the wall because I can't seem to figure out what is wrong. I've attached the session log and I thiiiink the error starts at the 18:51:45.576 mark. I use a 5070Ti GPU as well, if that helps figure out the issue

I've also attached screenshots of my streaming and recording settings in case that helps identify the problem as well.

 

[prgmitchell]

I'm having this error happen a lot lately, it's not every stream and I thought I had fixed the issue (depreciated encoder with the latest OBS update) but it's happened again today (after I'd been live for a few hours) and it's driving me up the wall because I can't seem to figure out what is wrong. I've attached the session log and I thiiiink the error starts at the 18:51:45.576 mark. I use a 5070Ti GPU as well, if that helps figure out the issue

I've also attached screenshots of my streaming and recording settings in case that helps identify the problem as well.

Your GPU driver is crashing, that is what is causing this error. Try running DDU and reinstalling the latest driver. If that doesn't work, reach out to NVIDIA for support

Performing a clean GPU driver installation

If you're experiencing strange issues or errors that might be related to your GPU drivers, one of the easiest potential fixes is a clean driver installation. Follow the instructions below. 1. Download the latest version of Display Driver...

obsproject.com

 

[Zellstice]

Your GPU driver is crashing, that is what is causing this error. Try running DDU and reinstalling the latest driver. If that doesn't work, reach out to NVIDIA for support

Performing a clean GPU driver installation

If you're experiencing strange issues or errors that might be related to your GPU drivers, one of the easiest potential fixes is a clean driver installation. Follow the instructions below. 1. Download the latest version of Display Driver...

obsproject.com

Thank you so much! I ran DDU and reinstalled the drivers fresh and it still happened during stream tonight :( I'll reach out to NVIDIA for support. I appreciate you taking the time to help!

 

[KillmediuM]

Hi,
I just wanted to share a quick fix that worked for me, since I recently built a new PC with an RTX 5070 Ti and ran into the same issue.

I had backed up my %appdata%\obs-studio folder to keep all my settings (profiles & scenes). But after copying it over to the new system and starting OBS, I got the same error you mentioned:
"NVENC Error: encode API internal error - NV_ENC_ERR_INVALID_PARAM"

Here’s what solved it for me:​

I deleted everything inside the obs-studio > basic > profiles folder and recreated my settings from scratch.
When setting up the encoder, I chose NVIDIA NVENC H.264 (Deprecated) — and streaming worked without any errors after that.

A friend of mine with the same GPU (RTX 5070 Ti) didn’t see two encoder options like I did — only the one without “Deprecated.” So I’m also curious:
@Moderator — why do some systems show both NVIDIA NVENC options, and others only one?

Here’s how it looks on my system: