Background Removal - Portrait Segmentation

Background Removal - Portrait Segmentation v0.4.0

Supported Bit Versions
  1. 64-bit
Source Code URL
https://github.com/royshil/obs-backgroundremoval
Minimum OBS Studio Version
27.0.0
Supported Platforms
  1. Windows
  2. Mac OS X
  3. Linux
This plugin makes it easy to replace the background in portrait images and video to create a virtual green screen. It uses a neural network to predict the mask of the portrait and remove the background pixels. It doesn't require a GPU and works in all OSs!
It's easily composable with other OBS plugins to replace the background with e.g. an image, a blurred background or a transparent color to create an overlay.

Demo
demo.gif


Blurred Background or Background Image
Add a chroma key to make the plugin make a transparent background, then add in the back a blurred view of the same camera or an image source.
bg_removal_blur.gif


(Icon made by https://www.flaticon.com/authors/bqlqn)
Author
royshilkrot
Downloads
224,653
Views
382,349
First release
Last update
Rating
3.13 star(s) 16 ratings

Latest updates

  1. v0.4.0 - OBS v27.1.3 and new RVM model

    In this release Upgrade to OBS v27.1.3 (latest) support New realtime model Robust Video Matting...
  2. v0.3.0 - New models! OBS v27!

    In this release Added 2 new lightweight segmentation models: Google Mediapipe "Meet" model...
  3. v0.2.4 Beta - MODNet model

    In this release Adding the MODNet segmentation model. Slightly better in segmentation and...

Latest reviews

It works goot, but it's not usable. The CPU (Intel I9-9900K) rises from around 2% to around 40%. The rendering time rises from 0,7-1ms to arond 130ms and the FPS dropping from 60fps to around 7-8fps.
The result with this plug is fine, but with an fps drop from 60fps to around 7-8fps means, that it is not usable acually.
There might be room for improvement (e.g. CPU load). I used MS Teams Meeting to create green background and captured screen with Chroma Key filter. This workaround consumed more resources and the result was only slightly better.
=>it might not be perfect but it's almost on the level of the feature from Microsoft -> clearly Excellent:)
It works great. But it also uses 40% CPU. When switch to GPU it still uses 40% cpu. Turn it off and obs cpu usage goes to 3%.
not perfect..

Reasons:
1. I don't know how, but most Video meeting Software does it better (Developers here wont have a professional Budget and Team - I am just objective). "Xsplit Vcam" in the free model has better BG removal, but it is limited to 720p and has a very present watermark.

2. with activated BG Removal, my CPU monitor inside OBS raises from 9% to 63% with "calculate mask every" 1 Frame, or 54% with every second frame.

3. Also, my webcam seems to loose FPS if BG Removal is activated.

I use:
LG 920C Webcam with OBS 27.2.1 64-bit.
Thank you, Thank you, Thank you for helping me break my dependence on ChromaCam and their 30fps limit...

Grabbed a logitech brio and the logitech litra glow and the background removal works fantastic.

I will say that in low-light situations the background removal will struggle. But that is going to be the same for any virtual background... Do yourself a favor, grab a diffused light source and help your camera out... you'll be surprised at the difference it makes.

I live in an apartment in queens and a physical green screen is not an option. Thank you royshilkrot, and also, f*ck chromacam...
Unfortunately, it doesn't work at all for me. Just crashes OBS when I try to select it. I'm using Linux if that means anything. Disappointing.
Wonderful plugin ... when it works. But it crashes OBS my Mac (both the release version and the candidate) when used together with e.g. a window capture device.
There is no Segmentation model choice on macOS, at least not on macOS 10.15.7, so the better mask generation models are not available. Whatever model is being used is terrible and results in a very rapidly moving mask that is unusable because it is so ugly.
I'm loving the plugin, however, it is randomly causing OBS to crash. If I remove the plugin, I get no crashes. Put it back, and I'll get crashes. Sometimes often other times only occasionally. I'm running Monteray on an iMac (2015). It generates a crash report but I've no idea where to send it.
I can't open it in both of my Macs. After I download it, it downloads to a folder so when I ask to unzip in Terminal it can't locate the file. When I manually copy it to Applications/OBS.app/Contents, the program doesn't recognize the file. It doesn't show up when click on the "+" sign to choose the program. I don't know why this isn't showing up. I ran it running Big Sur and Catalina
Top