- Supported Bit Versions
-
- 64-bit
- Source Code URL
- https://github.com/occ-ai/obs-localvocal
- Minimum OBS Studio Version
- 29.0.0
- Supported Platforms
-
- Windows
- Mac OS X
- Linux
LocalVocal live-streaming AI assistant plugin allows you to transcribe & translate, locally on your machine, audio speech into text and perform various language processing functions on the text using AI / LLMs (Large Language Models). No GPU required*, no cloud costs, no network and minimal lag! Privacy first - all data stays on your machine. (* GPU acceleration via CUDA is supported!)
Check out my AI for OBS tutorials and URL/API source! Be a 10x streamer / creator with free AI tools open source. Join me on Discord ! Check out LexiSynth Transcription+Translation all-in-one tool
If this plugin has been valuable to you consider adding a to the GH repo, rating it here on OBS, subscribing to my YouTube channel, and supporting my work: https://github.com/sponsors/royshil . Check out the Home for Open Source Content Creator AI: https://github.com/occ-ai
Do more with LocalVocal:
https://youtu.be/Q34LQsx-nlg | https://youtu.be/4BTmoKr0YMw | https://youtu.be/E7HKbO6CP_c
Realtime Translation with DeepL | Translate Apps and Videos
The plugin adds an Audio Filter - use it on a speech source (mic, video) to get a transcription. Send the captions to a Text Source to show on scene.
Current Features:
It's using the Whisper.cpp project from ggerganov to run the Whisper network in a very efficient way on CPUs and GPUs. For translation it's using CTranslate2 and the M2M100 model.
If you use this plugin - let us know! We would love to feature your work/vids and showcase your success.
Check out our other plugins:
Check out my AI for OBS tutorials and URL/API source! Be a 10x streamer / creator with free AI tools open source. Join me on Discord ! Check out LexiSynth Transcription+Translation all-in-one tool
If this plugin has been valuable to you consider adding a to the GH repo, rating it here on OBS, subscribing to my YouTube channel, and supporting my work: https://github.com/sponsors/royshil . Check out the Home for Open Source Content Creator AI: https://github.com/occ-ai
Do more with LocalVocal:
https://youtu.be/Q34LQsx-nlg | https://youtu.be/4BTmoKr0YMw | https://youtu.be/E7HKbO6CP_c
Realtime Translation with DeepL | Translate Apps and Videos
The plugin adds an Audio Filter - use it on a speech source (mic, video) to get a transcription. Send the captions to a Text Source to show on scene.
Current Features:
- Transcribe audio to text in real time in 100 languages
- Translate immediately to/from ~100 languages
- Display captions on screen using text sources
- Translate captions in real time to any language - see https://youtu.be/Q34LQsx-nlg or https://youtu.be/ryWBIEmVka4
- Remove unwanted words from the transcription
- Summarize the text and show "highlights" on screen
- Detect key moments in the stream and allow triggering events (like replay)
- Detect emotions/sentiment and allow triggering events (like changing the scene or colors etc.)
It's using the Whisper.cpp project from ggerganov to run the Whisper network in a very efficient way on CPUs and GPUs. For translation it's using CTranslate2 and the M2M100 model.
If you use this plugin - let us know! We would love to feature your work/vids and showcase your success.
Check out our other plugins:
- Background Removal removes background from webcam without a green screen.
- Detect will detect and track >80 types of objects in real-time inside OBS
- URL/API Source that allows fetching live data from an API and displaying it in OBS.