2 OBS Instances + 1920x1080 stream + 5760x1080 recording = encoder error

[AgentTekk]

What I am trying to accomplish is streaming one 1920x1080 60f canvas while recording a separate 5760x1080 60f canvas.
What I have going is two OBS instances, one running 1920x1080 60f setup for streaming and the other running 5760x1080 60f setup for recording.
I am able to stream and record while playing a game just fine for a couple minutes, then the monitors all freeze (audio continues) and I eventually get my PC back with an encoder error warning.
I'm using a 3070Ti and while streaming and recording, encoder usage is about 55%. The game I'm playing does not use an NVENC encoding session itself, so there should only be 2 active.

Here's the log I saw the error in. I need someone more experienced in OBS to help explain this to me as I have no idea what these messages mean in regards to OBS. Thank you!

https://obsproject.com/logs/EfRX28rTB1-3lNq3

PS - I have since disabled HAGS (as suggested by logs analyzer)

 

[PaiSand]

5760 it's over the maximum OBS can. There are several threads about this in the forum.

Also:

Analyzer | OBS

OBS (Open Broadcaster Software) is free and open source software for video recording and live streaming. Stream to Twitch, YouTube and many other providers or record your own videos with high quality H264 / AAC encoding.

obsproject.com

 

[AgentTekk]

I used the analyzer. Doesn't tell me anything I don't already know.
I'm using H.265, which supports 8092x8092.
I recorded GTA V for about 15 minutes without issue earlier today.

Might be just settings.

 

[Tomasz Góral]

Two instnces and one log, where is second?
RTX 30x0 can use 8192x8192 canvas, but on the first step i suggest run only one OBS and one hook to grab game with minimal scenes.
Next step add elements.