Ok, first of all thanks for this awesome branch, the difference in performance hit is staggering.
Sadly, it seems that for now there is no way to achieve decent quality at 3500 kbit/sec for a 1920x1080@30 recording, high motion is badly pixelated. This is ok though, since I mostly record for youtube and the video looks ok starting from 7000kbit/sec upwards.
I currently only record World of Warcraft.
That being said, I'm a bit unsure as to what settings seem to be optimal (is there any sort of documentation outside this forum post for this branch?)
Currently I'm using: Bitrate: 7500, Buffer Size: 15000, IDR: 60, GOP: 15 I'm fairly certain these settings are alright.
Quality preset, peak VBR encoding.
As already mentioned, I record 1080p@30fps
Now my main question is on OVE vs AMF. Which is better, or is any of them better at all? Using AMF with DX11 engine crashes WoW and OBS, DX9 and Host work fine though. I read that Host offloads some tasks to the CPU, but since for WoW both CPU and GPU are somewhat capped at ~50% each, it doesn't seem to quite matter. I read in this post that AMF has a slightly bigger impact on performance, but this is very hard to verify for me. Also quality wise, both OVE and AMF seem identical to me (very pixelated at 3500, good at 7000+). I really just would like to know which one is "better".
B-Frames/other confusion:
I have an MSI 3G Gaming R9 280. The non-X 280 supposedly shouldn't even have VCE supported, but it works without problem. That said, even the X version is listed under version 1.0 which supposedly doesn't support bframes. Now setting bframes (either with OVE or AMF) seems to work okay though (I set it to 6 and I get no errors or anything). On the other hand I don't even know if it actually encodes with bframes, mediainfo doesn't tell, is there any way I can find out if the encoding has bframes?
Also, even though I have set VCE to use VBR, on the Video settings tab CBR and CBR padding are ALWAYS checked. If I uncheck them, save and leave and reopen the settings, it will be checked again. VBR encoding is working though (if I stand still ingame, the average bitrate of the video will be far below the max allowed, so this seems to be just a UI bug). I can however change the quality modifier (1-10) if I uncheck CBR, change it and save, and the number will stick. Also which number should I use here, I suppose using high bitrates (7k+), 10 should be ok?
Sorry for the load of questions^^