You have reached and exceeded the limit of USB 3.0 possible raw speed of 500 MB/s, with the actual video limit a little lower due to protocol overhead and audio capture. This can cause excessive capture frame drop or possibly graphics glitches.
Reduce one or more the following:
1. change capture colorspace to YUY2 (4:2:2) or I420 / NV12 (4:2:0).
2. reduce capture frame rate or reduce refresh rate from a computer being captured.
3. reduce resolution on a computer being captured.
2560x1440, 100 fps, RGB32 (XRGB) (32 bit / 4 bytes per pixel) need 1475 MB/s, WAY TOO MUCH for USB 3.0
2560x1440, 60 fps, YUY2 (16 bit / 2 bytes per pixel) need 442 MB/s
2560x1440, 60 fps,I420/NV12(12 bit / 1.5 bytes per pixel) need 331 MB/s
1920x1080, 60 fps, YUY2 (16 bit / 2 bytes per pixel) need 248 MB/s
3840x2160, 30 fps,I420/NV12 (12 bits / 1.5 bytes per pixel) need 373 MB/s