You can disable it in the audio settings or just mute it in the OBS interface, the left volume slider is your microphone.
If you still can hear it afterwards, make sure in the advanced settings -> "Use Input device as desktop audio" is NOT checked. If it is checked, deactivate/uncheck it.