Code:
23:21:11.987: [texture-amf-av1] amf_av1_create_texencode: AMFComponent::Init failed: AMF_INVALID_ARG
Hardly believable that your card supports 2K-4K for AV1 encode with 10-bits in real-time. Maybe I'm wrong here, but at least try to reduce resolution in OBS to 1920x1080 (if it doesn't help - 10-bits AV1 encoding simply not supported for your device, so you can try other HDR capable encoder).
Edit: see posts about CQP rate control below.
Also,
Code:
23:19:22.451: refresh=165
23:19:22.451: bits_per_color=8
I don't think that this info is related to the issue but your display is reported to OS as 8-bit device, is it right setting?
And one more thing, the:
BufferDesc.Format: 87
---> DXGI_FORMAT_B8G8R8A8_UNORM
I see in the log - is 8-bit texture (
Game Capture source of OBS), so non-HDR source was selected for capture.
Expected format here is DXGI_FORMAT_R10G10B10A2_UNORM (BufferDesc.Format: 24) or something similar in case this is HDR source.