Question / Help Need some guidance on my encoding settings

[TinyBabyOwl]

Hi there. I just upgraded to a Ryzen 7 3800x and was excited to see what kind of stream quality I could manage with 8 cores and 16 threads.

So first my specs:
Ryzen 7 3800x
1080TI FE Hybrid
16GB DDR4 3000
x570 Aorus Master Mobo
350Mbps down 30 Mbps up

So using Nvenc I can easily stream 1080p @ 60 FPS @ 8000 bitrate. No frame drops or skips or anything. However the stream still doesn't look all that great. If I switch to x264 at the same bitrate and veryfast for cpu preset, the stream looks much higher quality but I get a lot of jitter.

What should I try to eliminate the jitter?

 

[Narcogen]

Use a faster preset.

For more information I'd have to see a logfile from a streaming session, but the reason why NVENC works smoothly is because it is dedicated hardware.

You can get better quality out of x264, but that will load your machine-- the jitter you describe is most likely encoding overload, and the way to resolve that would be to reduce load on the CPU, either by throttling other applications, or by reducing frame size, frame rate, or increasing encoder preset speed.

 

[TinyBabyOwl]

So I discovered that my RAM was running at 2133MHz instead of 3000. Upped it to 3000 and the jittering is 95% gone. Still running 1080p @ 60 FPS @ 9000 bitrate on veryfast too. I'm gonna stick some 3600 C16 RAM in next and it will be interesting to see the performance then. I know AMD is much pickier about RAM and especially with the 3000 series.