Introducing: CUDA for Windows!
Now compiling Whisper.cpp vs. CUDA 11 and 12 for GPU accelerated runtime on Windows, which can result in ~x5-x10 faster inference.
With GPU acceleration you can now go for bigger models like Medium and still have very fast transcription with incredible accuracy in many languages.
Also introducing MacOS Apple Silicon optimizations for M1/M2/M3 processors, which results in performance bumps and utilizes your hardware better.
Enjoy!
Download:
- obs-localvocal-0.2.0-macos-arm64.pkg 68.7 MB
- obs-localvocal-0.2.0-macos-x86_64.pkg 68.8 MB
- obs-localvocal-0.2.0-windows-x64-cuda11.8.0-Installer.exe 315 MB
- obs-localvocal-0.2.0-windows-x64-cuda11.8.0.zip 482 MB
- obs-localvocal-0.2.0-windows-x64-cuda12.2.0-Installer.exe 321 MB
- obs-localvocal-0.2.0-windows-x64-cuda12.2.0.zip 494 MB
- obs-localvocal-0.2.0-windows-x64-cudacpu-Installer.exe 71.5 MB
- obs-localvocal-0.2.0-windows-x64-cudacpu.zip 79.9 MB
- obs-localvocal-0.2.0-x86_64-linux-gnu.deb 67.9 MB
In this release:
Download:
- Bump Whisper.cpp - more CPU performance gains (~5-10% improvement)
- Adding an option to not truncate the output text file
In this release:
Enjoy!
- Bump Whisper.cpp for another ~10% gains in speed / processing
- Add "Simple Mode" for settings so people don't run away screaming :D
- Internal shuffling that results in a more robust plugin, less crashy
Download links:
This release bumps Whisper.cpp to a version that brings ~25% gains in performance (!), and also fixing the notorious "remove filter crash" bug.
Let me know if you experience any issues!
If you'd like to support my work consider Patreon or GitHub Sponsors, a on the repo would be greatly appreciated and a rating on the OBS forum
What's Changed
Full Changelog: 0.0.6...0.0.7
- Bump whisper version for 25% speed gains by @royshil in #51
- Add -fPIC to plugin-support on linux by @royshil in #54
- Fix destroy crash by @royshil in #55
- Bump whispercpp and fix mac build by @royshil in #56
In this release: Minimum subtitle display duration, removing the vexing [skip] message, fixing ALL unicode languages as well as Windows UTF8 paths for custom model files
If this plugin has provided value to you consider adding a on the repo, subscribing to my YouTube channel where I post updates, and supporting my work: https://github.com/sponsors/royshil
What's Changed
Full Changelog: 0.0.5...0.0.6
- Adding min sub render duration by @royshil in #46
- Fix windows Unicode model path and characters display by @royshil in #47
In this release I'm fixing an important bug with UTF8 characters not being handled properly on Windows. Also an change that allows for far faster builds.
If this plugin has provided value to you consider adding a on the repo, subscribing to my YouTube channel where I post updates, and supporting my work: https://github.com/sponsors/royshil
Installers:
A very exciting release! We have improvements and new features all around:
If this plugin has provided value to you consider adding a on the repo, subscribing to my YouTube channel where I post updates, and supporting my work: https://github.com/sponsors/royshil
- Saving subtitles to .srt files
- Saving subtitles aligned to OBS recordings (timestamp, filename)
- Using external Whisper models
- CUDA support for Windows
- Disable on audio source mute
- Fixing UTF8 characters for certain languages
- Translation of the UI
What's Changed
Full Changelog: 0.0.3...0.0.4
- Install CUDA DLLs to the plugin release dir by @royshil in #22
- Add the option to select an external Whisper.cpp model file by @royshil in #25
- Fix osx build by @royshil in #29
- Fixing crash on linux filter add by @royshil in #28
- fix model load, fix Russian utf8 on Windows by @royshil in #31
- Locale and translations by @royshil in #33
- Fix CI by @umireon in #37
- Revert Fix CI partially by @umireon in #38
- srt subtitles file saving and source mute detection by @royshil in #36
In this release we have several important updates: send captions to an RTMP stream, fixing the model download issues, step-by-step transcription (realtime transcription effect). New version of Whisper.cpp has major speedup on Mac CPUs!
If this plugin has provided value to you consider adding a on the GH repo, subscribing to my YouTube channel, and supporting my work: https://github.com/sponsors/royshil
I will upload a new video soon with instructions on the new features.
What's Changed
- Add caption to stream option by @royshil in #13
- Move models to config folder by @royshil in #17
- fix: Windows CUDA compilation was incorrectly described by @Destroy666x in #15
- Add step-by-step processing by @royshil in #18
New Contributors
Full Changelog: 0.0.2...0.0.3
- @Destroy666x made their first contribution in #15