Actually Sapiens, it is. I regularly have viewers hovering between 30s-1m, but have quite a lot with around 3 minutes of delay, and 1-2 viewers who regularly get 6-10 minutes of delay. It's quite ridiculously bad.
Though the delay will get worse for everyone watching if you're dropping frames, apparently. Only thing you can do is make sure you don't drop any, or tell them to refresh the page.