Newer versions of osu use opengl or?
This is a bug with game capture, opengl applications and certain AMD cards.
You can enable multi adapter compatibility in the game capture properties to fix it (will reduce performance).
You need OBS Studio for that (which you should use nowadays anyway).