Question / Help Mic stops working

So sometimes when I start streaming my mic isn't being picked up, I can see it picking up my voice in OBS but it's not coming through to the stream. So I have to go in and remove my mic, apply the setting then pick the mic again and apply, go in and fix the mic settings again.

It's very annoying not knowing if the sound from my mic is going to come through or not, so I have to listen to the stream to know if it's working or not.

Anyone know what could cause this ? I use a Yeti Blue and I've not had any issues before, the mic works perfectly.
I do switch between two Profiles and Scene Collections when I stream and record, I'm thinking there is something going on there, but there is no issue on my recording setup.
 
Top