From the Live chat Factoid written by fenrir:
To use the Audio Monitoring feature, click Edit -> Advanced Audio Properties and set Audio Monitoring to either Monitor Only, or Monitor and Output. Monitor Only will not output that device's audio to your stream/recording. Audio for that device will be played out of your system default device, unless otherwise specified in Settings -> Advanced.