X264 or Nvenc

Carlos726811

New Member
Hi guys which encoder would people advice on a single pc setup for gaming and streaming same time What settings would people advicr me to use. I am a twitch affiliate and my cpu is a 3900x and my gpu is a rtx 3080 upload speed is 37mbps could u tell me best settings please and which to use
 

DarthNox

Member
For best performance and quality go for nvenc

Settings For Streaming:
Rate Control = CBR
Bitrate = 6000 (twitch caps at that)
Preset = Max Performance (there is no difference in quality for 30 series nvidia cards between Max Quality and Max Performance, and Max Quality just causes encoding lag)
Profile= High
GPU= 0
Look ahead = unchecked
Psycho visual tuning = checked
Max B frames = 0
 

FerretBomb

Active Member
To get a good baseline, go to the Tools menu and run the Auto-Configuration Wizard.

As you have a 30-series nVidia card, NVENC will produce video on-par with the x264 Slow preset (which is extremely good).
Advise using the Quality preset, with both Lookahead and Psychovisual Tuning OFF. (Max Quality, PVT and Lookahead use CUDA cores which can affect in-game performance, and generally just cause encoding overloads in situations where it should not occur.)
 

Carlos726811

New Member
To get a good baseline, go to the Tools menu and run the Auto-Configuration Wizard.

As you have a 30-series nVidia card, NVENC will produce video on-par with the x264 Slow preset (which is extremely good).
Advise using the Quality preset, with both Lookahead and Psychovisual Tuning OFF. (Max Quality, PVT and Lookahead use CUDA cores which can affect in-game performance, and generally just cause encoding overloads in situations where it should not occur.)

Just doing auto-configuration wizard. Shall i leave prefer hardware encoding and estimate bitrate with bandwidth test both ticked.
 

TryHD

Member
why use b frames? They are for compression and and can sometimes hurt quality. Carlos726811's internet could handle a straight 6,000 kbs stream
your settings hurt quality really bad, the difference between max performance no b frames and max quality with bframes is huge. 6000 kbit/s is already with a quality compromise and you recommend to reduce the quality even more.
 

FerretBomb

Active Member
Just doing auto-configuration wizard. Shall i leave prefer hardware encoding and estimate bitrate with bandwidth test both ticked.
That's what I'd do, yes. When it completes, I'd make those alterations though. Quality preset, Lookahead off, Psychovisual Tuning off. Keyframes to 2 (to comply with Twitch spec). It should automatically do all of these, but sometimes leaves PVT on for some reason. You can leave it on if you like (and it IS a very minor visual quality improvement), but if you start getting 'encoder overloaded' on NVENC, PVT should be the first thing you turn off if you do.
 

Carlos726811

New Member
That's what I'd do, yes. When it completes, I'd make those alterations though. Quality preset, Lookahead off, Psychovisual Tuning off. Keyframes to 2 (to comply with Twitch spec). It should automatically do all of these, but sometimes leaves PVT on for some reason. You can leave it on if you like (and it IS a very minor visual quality improvement), but if you start getting 'encoder overloaded' on NVENC, PVT should be the first thing you turn off if you do.

Hi. So the settings now is.

Streaming,
Encoder Nvidia Nvenc H.264 ( NEW )
Rescale output unchecked at 1920x1080
Rate Control CBR
Bitrate 6000Kbps
Keyframe 2
Preset Quality
Profile High
Look ahead Unchecked.
Psycho Visual Tuning Unchecked
GPU 0
Max B Frames 2

But for some reason i am struggling to game and stream THE MEDIUM Game, with those settings even on X264.
In game graphics turned down and still struggling to do both at same time, I noticed In my task manager my OBS hitting around 50%+ usage of my GPU
 

DarthNox

Member
your settings hurt quality really bad, the difference between max performance no b frames and max quality with bframes is huge. 6000 kbit/s is already with a quality compromise and you recommend to reduce the quality even more.
there is no difference in quality between Max Quality and Max Performance for the Turing nvenc (16/20/30 series gpus), and I do not see how removing compression reduces quality especially at 6000 kbs
 

FerretBomb

Active Member
there is no difference in quality between Max Quality and Max Performance for the Turing nvenc (16/20/30 series gpus), and I do not see how removing compression reduces quality especially at 6000 kbs
There absolutely is a difference, according to VMAF testing. It's fairly minimal though.
Max Quality also enables 2-pass, which causes a LOT of problems when encoding realtime video (it also uses CUDA cores which can have an effect on in-game performance).
Quality (not Max Quality) is the general recommendation.
 
Top