New Hardware, very poor OBS performance

[illumina7]

Hello,
yesterday my new hardware was delivered and I installed it as well.
Until now my setup was this:
- i7-4930k
- 32GB DDR3 1333 Quad-Channel
- Asrock X79 extreme9
- Creative Soundblaster Z
- Primary GPU: Sapphire RX 5700XT Pulse (Gaming)
- Secondary GPU: PNY Geforce GTX780 (OBS Studio encoding)
- 3 Monitors, 1x 28" UHD@60fps Samsung, 2x 22" FHD@60fps BenQ
- a bunch of SSDs and HDDs
- Win 10 Pro

My new Setup:
- i9-10900F (unlocked 125W)
- 32GB DDR4 3200 Dual Channel
- Asrock Z490 Phantom Gaming 4
- Creative Soundblaster Z
- Primary GPU: Sapphire RX 5700XT Pulse (Gaming)
- Secondary GPU: PNY Geforce GTX780 (OBS Studio encoding)
- 3 Monitors, 1x 28" UHD@60fps Samsung, 2x 22" FHD@60fps BenQ
- a bunch of SSDs and Hdds
- Win 10 Pro

Internetconnection is a 1Gbit down/50Mbit up from Vodafone in Germany.
Until now I was using the GTX780 only for OBS Studio encoding via NVENC codec and it worked out pretty well on 1600x900@60fps with 6500kbit/s bandwith on my old hardware. The stream was absolut flawelessly, stable and smooth at 60fps, no drops nothing.

After installing and setup my new hardware (haven't reinstalled Win 10 Pro), cleaning with DDU all display drivers and reinstalled them, first the AMD drivers, second the Geforce drivers, installing the chipset/mainboard etc. drivers, deinstalled every old driver and hardware from the device manager, I've trying to stream again.

Now it should work much better, in game my fps increased very much with the ne CPU (CoD:Warzon), from around 70fps @FHD maxed out to around 130fps @FHD maxed out and works damn smoth without any microstutter or something.

BUT OBS Studio is now working like crap. While rendering, the fps are decreasing to around 20-30 and every third render-picture is dropped (around 30%). So to say, the stream is working like garbage. (Only in OBS, the game itself is working very well without any issues.)
I have tried everything to get this to work again:
- encoding with AMD/CPU codec -> same
- de-/increasing rendering settings from lowest to highest with every codec -> always the same
- de-/activate Windows Game Mode -> no improvement
- deinstall and wipe OBS Studio directorys -> no differences
- switched between game recording and screen recording -> no differences
- start OBS elevated -> no improvement
- some other stuff I have read while searching the internet for solution -> no improvement

Some ideas for a solution of my problem?

Greetings
illumina7
(sry for bad english on some points)
ps: I can attach some logfiles in the afternoon, when I am back home from work

 

[illumina7]

I've solved the problem on my own.
If somebody else has ever a similar problem, this is what I finally did:
(- first: backup your szenes, probably the profile, but I used a new one to avoid errors from the profile)
- uninstalled every Plugin for OBS
- uninstalled OBS Studio
- deleted the OBS Folder C:\Program Files\obs-studio
- delete all files in the temp folder C:\Windows\Temp
- delete all files in the profile temp folder C:\Users\%username%\AppData\Local\Temp
- performed a system cleanup (rightclick on disk C:)
- startet regedit as administrator an searched it for "obs-studio" - deleted every single entry I found
- reinstalled the nvidia driver paket with set to defaults
- reboot
- installed obs and my necessary plugins
- setup my stream settings and connection to twitch
- imported my szene backup
- go for it! now it works perfectly again, I am playing with the RX5700XT while the GTX780 renders the stream with high settings stable @60fps. :)