PTZ camera control with Nvidia RTX Broadcast Engine face tracking?

[jdhicke]

I use OBS to stream church services using a PTZOptics PTZ camera. I just stumbled across some information about the Nvidia RTX Broadcast Engine and the face tracking capabilities.

NVIDIA Maxine

SDK for building video conferencing, content creation and streaming applications.

developer.nvidia.com

(specifically the AR SDK)

Would it technically be possible for someone (much smarter than me) to come up with a plugin to drive the camera position using the face tracking?? Seems like a really exciting prospect, especially since tracking systems start around $1000. Since PTZOptics already has an OBS plugin that lets you control the camera, seems like it would "just" be getting the face location out of the GPU and linking that to the camera control. Is this doable or much more difficult than it seems?

 

[ElijahTheProfit]

Please let me know if there is any way you have figured out how to integrate maxine into obs. I am doing the same thing streaming church services and maxine now has body tracking which i am trying to get onto obs. All these other churches either figured it out or have expensive tracking systems and I know theres a way to do it on the software side through obs i just dont know how!

 

[Pando]

Panasonic has a face tracking app that integrates with their PTZ cameras.
Panasonic AW-SF100 PTZ Auto Tracking Software