OBS now has severe audio delay?

[IYIomo]

So I recently bought a pair of headphones that had an in-line mic to record my voice for gameplay and at the beggining it was fine and worked as I wanted it to, however I had tried to change my setup (which didn't work) so I reverted it back to the way it was but now my audio has a severe delay, like 10s but if i leave OBS open for maybe 15-20 mins the audio delay corrects itself. I am completely baffled as to why this is happening and if there is a fix aside from waiting the 15-20 mins everytime I open OBS.