New background removal library

[dack]

https://github.com/PeterL1n/RobustVideoMatting

A plugin using this library for background removal would be amazing. I've tested their code locally with my webcam, and it works very well. It gave better results than any other background removal I have tried (even proprietary ones like nvidia broadcast). It's fast as well (the web demo is slow, but it's fast when run locally).

 

[spatenotte]

I'm interested in this too, but I haven't been able to figure out how to run it. Do you have any sample code you can share? Thanks!

 

[WaveSim]

WoW. look so amazing.

 

[dack]

@spatenotte - To test it, I just installed the requirements and ran inference.py with some recorded video clips. I don't have any code other than what's already in the repo.

 

[Bobby©]

A bundle of this library integrated into KostiaChorny's BGMv2-webcam-plugin-linux running over letmaik's
pyvirtualcam is promised to make it useful in OBS. Unfortunately, my laptop has AMD Radeon Vega GPU and this bundle fails to start as it's targeted NVIDIA Cuda GPU. Does anyone have any idea how to make it run with other GPUs or at least just on a CPU power?

 

[spatenotte]

I actually found these two libraries that integrate directly into OBS: https://github.com/kounoike/obs-virtualbg, https://github.com/royshil/obs-backgroundremoval.