Question / Help Increasing video latency with Avermedia Live Gamer Portable Lite

I've been trying to capture gameplay with the LGP Lite, and every time, the video delay increases some. I have tried turning off the buffer setting, which works, but it makes the capture more choppy. The best solution I've found is to disable and re-enable the capture. However, it's a very temporary solution. I am aware that USB 2 cards aren't as good as internal or USB 3, but I didn't expect the increasing delay.