I'm suspecting your base resolution and actual screen resolution don't match
When you add the Display Capture source, I'm guessing it adds it to your scene at Full resolution (ie, more than your OBS canvas)
So Tomasz mention one approach. The other would be to right-mouse click the source, and Choose Transform, and set that to fit screen, etc