Detect - Object Detection, Tracking built-in OBS v0.0.3

A plugin that allows you to detect >80 types of objects in any source, track them and apply masking.

If you like this work please consider supporting it by sponsoring us on GitHub, Patreon or OpenCollective

This work uses the great contributions from EdgeYOLO-ROS and PINTO-Model-Zoo.
Contact us for assistance! Visit OCC-AI in our Discord server or on Github

Usage​

• Add the "Detect" filter to any source with an image (Media, Browser, VLC, Image, etc.)
• Enable "Masking" or "Tracking"

Use Detect or track your pet or blur out people in your video!

See a feature by @Andilippi on creatively using the plugin for many fun things! https://www.twitch.tv/videos/2104923413
See a tutorial in Spanish by Angel Mendez https://www.youtube.com/watch?v=E2bO3YcAeo4

Features​

Current features:

• Detect over 80 categories of objects, using an efficient model (EdgeYOLO)
• 3 Model sizes: Small, Medium and Large
• Control detection threshold
• Select object category filter (e.g. find only "Person")
• Masking: Blur, Solid color, Transparent, output binary mask (combine with other plugins!)
• Tracking: Single object / All objects, Zoom factor, smooth transition

Roadmap features:

• Precise object mask, beyond bounding box
• Implement SORT tracking for smoothness
• Multiple object category selection (e.g. Dog + Cat + Duck)
• Make available detection information for other plugins through settings
• More real-time models choices