This is, unfortunately, a known issue with FTL on macOS. The full details are available on OBSProject Mantis Issue 1240 and mixer/ftl-sdk Pull Request 67. We're basically waiting for Mixer to fix it at this point. Until then, you'll have to use RTMP when streaming to Mixer on macOS.