TheNukem
New Member
Hi all.
I've been a lurker on these forums for a while, but recently I've not been able to sit by and watch.
So this is a call out to someone who has skills far beyond mine....and I can tell you that having read a LOT of posts on these kind of forums, that this is a plugin that people are crying out for.
It'll save $1,000s of dollars on these crappy PTZs that claim to have AI tracking. OBS can do it all.
There are 2 awesome plugins that basically need linking, but I'm not the one to do it. I'm techie AF, but not a coder.
https://github.com/glikely/obs-ptz/
AND
https://github.com/locaal-ai/obs-detect
This is how I see it flowing:
a few challenges:
Assuming that 'detect' already calcs the x, y positioning, then that data needs to feed it into PTZ control with an instruction set along the lines of 'if object is 'z' number of pixels off a specific point, then move camera until object is within tolerance.
Like I say, I'm no coder, but I am an award winning film maker as well as doing lots of multi-cam (PTZs) streaming of live events, performances and conferences. If I can be of any help to you in the development process, please let me know.
I've been a lurker on these forums for a while, but recently I've not been able to sit by and watch.
So this is a call out to someone who has skills far beyond mine....and I can tell you that having read a LOT of posts on these kind of forums, that this is a plugin that people are crying out for.
It'll save $1,000s of dollars on these crappy PTZs that claim to have AI tracking. OBS can do it all.
There are 2 awesome plugins that basically need linking, but I'm not the one to do it. I'm techie AF, but not a coder.
https://github.com/glikely/obs-ptz/
AND
https://github.com/locaal-ai/obs-detect
This is how I see it flowing:
- OBS captures video → Object Detection Plugin processes frames.
- Detection script calculates object position → sends PTZ adjustments.
- PTZ Plugin translates this into VISCA commands → Camera moves.
a few challenges:
- Latency: PTZ movement may lag behind fast-moving objects.
- Smoothing: I'll need to implement dead zones (only move if object is >X pixels off-center).
- Calibration: Fine-tune pan/tilt speeds for smooth tracking.
Assuming that 'detect' already calcs the x, y positioning, then that data needs to feed it into PTZ control with an instruction set along the lines of 'if object is 'z' number of pixels off a specific point, then move camera until object is within tolerance.
Like I say, I'm no coder, but I am an award winning film maker as well as doing lots of multi-cam (PTZs) streaming of live events, performances and conferences. If I can be of any help to you in the development process, please let me know.