Yes. OBS launches on one GPU or the other. It can't switch between them without restarting.
The only other solution would be a USB capture device. Usually that's pointless in a single PC configuration, but in your case you could just mirror your display to an external port, connect that to the capture card, and use that as your source in OBS.