Detect - Object Detection, Tracking built-in OBS v0.0.3

[EB123]

many PTZ cameras use similar control protocols, VISCA seems to be common but there is also HTTP and some others.. this page has example HTTP and VISCA API for a generic PTZ camera... https://www.prisual.us/pages/downloads

there is an existing OBS PTZ plugin for manual camera control.. if you were to try and add this support, would it be better to output control data from your plugin direct to the existing OBS PTZ plugin ? or better to send HTTP or VISCA directly from your plugin to the camera ? either way it would be a great feature to see added.. the user could create a "virtual camera man" which would help automate smaller productions..

 

[r3dd3vil]

hello m8, thanks for your great work!! I have a question, if i have for example 3 people talking in a video, is there a way to tell to the plugin zoom in on the first person from left, or zoom to the one on the center ecc? If not, it will be great to have that option available!

 

[royshilkrot]

many PTZ cameras use similar control protocols, VISCA seems to be common but there is also HTTP and some others.. this page has example HTTP and VISCA API for a generic PTZ camera... https://www.prisual.us/pages/downloads

there is an existing OBS PTZ plugin for manual camera control.. if you were to try and add this support, would it be better to output control data from your plugin direct to the existing OBS PTZ plugin ? or better to send HTTP or VISCA directly from your plugin to the camera ? either way it would be a great feature to see added.. the user could create a "virtual camera man" which would help automate smaller productions..

Yeah that sounds like a feature that's not too hard to implement. I'll look into it after I take care of re-identification.

 

[royshilkrot]

hello m8, thanks for your great work!! I have a question, if i have for example 3 people talking in a video, is there a way to tell to the plugin zoom in on the first person from left, or zoom to the one on the center ecc? If not, it will be great to have that option available!

It's not yet possible to select single objects because their IDs are jumping around too much for a consistent tracking. I'm working on a stable tracking algorithm (called DeepSORT). It will be available soon and then I'll add the object selection option

 

[EB123]

Yeah that sounds like a feature that's not too hard to implement. I'll look into it after I take care of re-identification.

I installed the plugin last night.. from my quick tests it does an excellent job with identification of people and faces. if you end up adding PTZ control it could be very useful feature to help automate small productions.. I'll keep an eye on updates.. great work.

 

[FPHK666]

royshilkrot submitted a new resource:

Detect - Object Detection, Tracking built-in OBS - Real-time Detect, Follow, Zoom or Blur/Mask over 80 categories of objects. No GPU required*



Read more about this resource...

Very Nice and thank you very much for this tracking plugin I’m now trying to setup this for my billiard game to track all the snooker ball with different points but I’m curiously can it go sync with the scoreboard like track the ball goes into pocket it will automatically adding point on scoreboard ….

 

[LukeT]

I’m wondering if it is possible to optimise for MacOS? Sorry if this is a silly idea. It is just that I feel that somehow it uses a lot of resources on my M1 MacBook Air and I can’t see any difference on face or person detection whether I use CoreML or CPU at the moment… doesn’t feel like it is optimised. Will using Metal help?

 

[vsin]

I am wondering if it is possible to build a plugin to help write in air, where the plugin follows a particular color in scene and traces a path. The color of the path can be changes using an hotkey and erasing every path using a hotkey. There are various examples of this done using openCV Here is link to one such project. https://www.geeksforgeeks.org/create-air-canvas-using-python-opencv/
Can you please build it as a plugin/script where it takes a source video and tracks the color (planning on using an led in ppt clicker).And overlays the path on to the original video.

I teach on youtube using green screen, this could help me highlight parts in the scene without having to buy a smart board.

 

[PTZparty]

Hey, I'd like to help implement PTZ movement through VISCA (UDP), just like PTZ Controls

 

[THEOPELCAMBOSECURE]

hello i have installed the windows installer, but i am really struggling to find it in the obs software, i click on my webcam source, and then i click filters, and i can only see the bog standard filters that come with OBS, please please help

 

[petjo10]

Thanks for a great functional plugin. I use it almost daily when I film lectures at the hospital in Skövde where I work. Sometimes I film two people giving a lecture. On these occasions, it would have been good if you could "jump" between face 1 and 2 with a keyboard shortcut. Hope it can be arranged. Regarding Peter Johansson

 

[imbrock]

Hello, this plugin is really well made thank you!

I was wondering how hard it would be to get it to load arbitrary shaders? I could see this being a lot of fun combined with things that work in the obs shader loader filter project.

Thanks again for your hard work

 

[henrich45]

Thanks for the suggestions
You're welcome to join our discord server and post anything you think would be useful
But I think the best tracking solution would be to train a model to find the objects you're interested in. Training is not simple... Doable though. Once you get a dataset then it's just matter if you have the hardware GPU etc.
I'll be working on the tracking and selection soon. becabenitojuarez.com

Thanks for the invitation to join the Discord server! I'll definitely check it out and contribute any useful ideas. I agree that training a model would be a solid solution for tracking. It's a challenging task, but with the right dataset and hardware, it's definitely achievable. Looking forward to your work on tracking and selection!