In my OBS settings I checked the 'Use CBR' and the 'Enable CBR padding' settings but on Twitch it says (dashboard) that I didn't check the 'Use CBR' setting.
I'm using the Nvidia NVENC by the way, when I was using the x264 encoder everything was fine.