If you mean a grid, View/Multiview as Banyarola said.
If you mean a 'hall of mirrors' effect with many nested, repeating captures fading into the distance, that happens when you use a Display Capture and OBS is on the screen you're capturing... just like pointing a camera at a TV showing the camera's output, called the Droste effect. It's acting as-intended, showing what's on-screen, which is showing what's on-screen, which is... you get it.
Move OBS to a non-captured monitor, or use a different capture type.