Funny, just wanted to open a thread this moment with the same topic ^^
I've tested a lot last weekend because i also noticed differences between dxtory and obs classic/studio.
I testes with two games: Layers Of Fear and The Forest (both unity)
I noticed that recording with dxtory results in smoother recordings, especially when the ingame fps drops to lower than recording fps (ingame 55fps recording 60fps)
you can see it espacially when the game is using motion blur (heavily used by the forest)
dxtory has smoother results.
obs classic performs a bit better, also studio 0.12.1 works bettern and if you have desktop+game capture on youre scene it's more worse.
if you deactivate or delete desktop capure from you scene, game capture seems a bit smoother (and yes, game capure layer is over desktop capture and has full size).
my settings are:
dxtory: magicyuv 1.2 codec, 2 audio track wav 44.100
obs classic: x264 lossless qp=0, audio 44.100 320 aac
obs studio: x264 lossless qp=0, two audio tracks aac 320 44.100
cpu usage when encoding is on ~30% with studio and ~20-25% with classic
but you don't need to encode it all; you can already see in in the preview (without encoding)
recording at 2k@60fps
xeon e3-1231v3 quadcore, 32GB Ram, GTX970, recording to 2x WD Green Raid0 (~230MB/s writing)
i could make some samples and logs if you want.
thx