LocalVocal: Local Live Captions & Translation On-the-Go v0.3.1

In this release:

• Adding more whisper model options
• Only allowing English selection for English models
• Freeing up resources on filter disable
• Fixing a bug to make accurate timestamps

Download:

• obs-localvocal-0.3.1-macos-arm64.pkg 85.5 MB
• obs-localvocal-0.3.1-macos-x86_64.pkg 85.9 MB
• obs-localvocal-0.3.1-source.tar.xz 72.1 MB
• obs-localvocal-0.3.1-windows-x64-cpu-Installer.exe 75.4 MB
• obs-localvocal-0.3.1-windows-x64-cpu.zip 86.4 MB
• obs-localvocal-0.3.1-windows-x64-cuda11.8.0-Installer.exe 330 MB
• obs-localvocal-0.3.1-windows-x64-cuda11.8.0.zip 523 MB
• obs-localvocal-0.3.1-windows-x64-cuda12.2.0-Installer.exe 337 MB
• obs-localvocal-0.3.1-windows-x64-cuda12.2.0.zip 534 MB
• obs-localvocal-0.3.1-windows-x64-cudaclblast-Installer.exe 76.1 MB
• obs-localvocal-0.3.1-windows-x64-cudaclblast.zip 87.9 MB
• obs-localvocal-0.3.1-x86_64-linux-gnu.deb 77.5 MB

Big release! Many improvements, solving a lot of bugs and introducing far better performance.
In points:

• VAD based segmentation - no more "3 seconds segments"! when speech is detected the transcription kicks in
• Incremental output: The captions will appear continuously as you speak, a live transcription effect
• Bumping the version of whisper.cpp
• Many more options for real-time translation
• A lot of bug fixing...

Download

• obs-localvocal-0.3.0-macos-arm64.pkg 85.5 MB
• obs-localvocal-0.3.0-macos-x86_64.pkg 85.9 MB
• obs-localvocal-0.3.0-windows-x64-cpu-Installer.exe 75.4 MB
• obs-localvocal-0.3.0-windows-x64-cpu.zip 86.4 MB
• obs-localvocal-0.3.0-windows-x64-cuda11.8.0-Installer.exe 330 MB
• obs-localvocal-0.3.0-windows-x64-cuda11.8.0.zip 523 MB
• obs-localvocal-0.3.0-windows-x64-cuda12.2.0-Installer.exe 337 MB
• obs-localvocal-0.3.0-windows-x64-cuda12.2.0.zip 534 MB
• obs-localvocal-0.3.0-windows-x64-cudaclblast-Installer.exe 76.1 MB
• obs-localvocal-0.3.0-windows-x64-cudaclblast.zip 87.9 MB
• obs-localvocal-0.3.0-x86_64-linux-gnu.deb 77.5 MB

A big release. Fixing things and adding evaluation tools

• Fixing Linux problems with missing dependency
• Testing tools and scripts for evaluating the algorithm
• Add Whisper-based translation
• Add M2M100 1.2B model for translation
• Optimizing overlap regions
• Sentence suppression fixup

Download

• obs-localvocal-0.2.6-macos-arm64.pkg 85.3 MB
• obs-localvocal-0.2.6-macos-x86_64.pkg 85.7 MB
• obs-localvocal-0.2.6-windows-x64-cpu-Installer.exe 75.4 MB
• obs-localvocal-0.2.6-windows-x64-cpu.zip 86.3 MB
• obs-localvocal-0.2.6-windows-x64-cuda11.8.0-Installer.exe 327 MB
• obs-localvocal-0.2.6-windows-x64-cuda11.8.0.zip 514 MB
• obs-localvocal-0.2.6-windows-x64-cuda12.2.0-Installer.exe 333 MB
• obs-localvocal-0.2.6-windows-x64-cuda12.2.0.zip 526 MB
• obs-localvocal-0.2.6-windows-x64-cudaclblast-Installer.exe 76.1 MB
• obs-localvocal-0.2.6-windows-x64-cudaclblast.zip 87.9 MB
• obs-localvocal-0.2.6-x86_64-linux-gnu.deb 77.5 MB

Our BEST version of LocalVocal yet!

Bumping whisper versions, fixing buffers for smooth transitions, simplifying UI, adding suppression mechanism...
It's an overhaul...

Enjoy!

• obs-localvocal-0.2.3-macos-arm64.pkg 85.2 MB
• obs-localvocal-0.2.3-macos-x86_64.pkg 85.6 MB
• obs-localvocal-0.2.3-source.tar.xz 69 MB
• obs-localvocal-0.2.3-windows-x64-cpu-Installer.exe 75.4 MB
• obs-localvocal-0.2.3-windows-x64-cpu.zip 86.3 MB
• obs-localvocal-0.2.3-windows-x64-cuda11.8.0-Installer.exe 327 MB
• obs-localvocal-0.2.3-windows-x64-cuda11.8.0.zip 514 MB
• obs-localvocal-0.2.3-windows-x64-cuda12.2.0-Installer.exe 333 MB
• obs-localvocal-0.2.3-windows-x64-cuda12.2.0.zip 526 MB
• obs-localvocal-0.2.3-windows-x64-cudaclblast-Installer.exe 76.1 MB
• obs-localvocal-0.2.3-windows-x64-cudaclblast.zip 87.9 MB
• obs-localvocal-0.2.3-x86_64-linux-gnu.deb 77.4 MB

This version adds built-in translation for live captioning.
Translating to-and-from ~100 languages, simply by clicking a button.

Enjoy!

Download:

• obs-localvocal-0.2.1-macos-arm64.pkg 70.5 MB
• obs-localvocal-0.2.1-macos-x86_64.pkg 70.8 MB
• obs-localvocal-0.2.1-windows-x64-cpu-Installer.exe 72.2 MB
• obs-localvocal-0.2.1-windows-x64-cpu.zip 80.8 MB
• obs-localvocal-0.2.1-windows-x64-cuda11.8.0-Installer.exe 323 MB
• obs-localvocal-0.2.1-windows-x64-cuda11.8.0.zip 506 MB
• obs-localvocal-0.2.1-windows-x64-cuda12.2.0-Installer.exe 329 MB
• obs-localvocal-0.2.1-windows-x64-cuda12.2.0.zip 518 MB
• obs-localvocal-0.2.1-x86_64-linux-gnu.deb 69.2 MB

Introducing: CUDA for Windows!
Now compiling Whisper.cpp vs. CUDA 11 and 12 for GPU accelerated runtime on Windows, which can result in ~x5-x10 faster inference.
With GPU acceleration you can now go for bigger models like Medium and still have very fast transcription with incredible accuracy in many languages.

Also introducing MacOS Apple Silicon optimizations for M1/M2/M3 processors, which results in performance bumps and utilizes your hardware better.

Enjoy!

Download:

• obs-localvocal-0.2.0-macos-arm64.pkg 68.7 MB
• obs-localvocal-0.2.0-macos-x86_64.pkg 68.8 MB
• obs-localvocal-0.2.0-windows-x64-cuda11.8.0-Installer.exe 315 MB
• obs-localvocal-0.2.0-windows-x64-cuda11.8.0.zip 482 MB
• obs-localvocal-0.2.0-windows-x64-cuda12.2.0-Installer.exe 321 MB
• obs-localvocal-0.2.0-windows-x64-cuda12.2.0.zip 494 MB
• obs-localvocal-0.2.0-windows-x64-cudacpu-Installer.exe 71.5 MB
• obs-localvocal-0.2.0-windows-x64-cudacpu.zip 79.9 MB
• obs-localvocal-0.2.0-x86_64-linux-gnu.deb 67.9 MB

What's Changed​

• Update Whisper.cpp version by @royshil in #72
• Variable buffer size options by @royshil in #66
• Fix Max Channels, Update macOS brew command and fix compiler warnings by @royshil in #75

Download

• obs-localvocal-0.1.1-macos-universal.pkg 70.2 MB
• obs-localvocal-0.1.1-windows-x64-Installer.exe 71.5 MB
• obs-localvocal-0.1.1-windows-x64.zip 79.9 MB
• obs-localvocal-0.1.1-x86_64-linux-gnu.deb 67.9 MB

In this release:

• Bump Whisper.cpp - more CPU performance gains (~5-10% improvement)
• Adding an option to not truncate the output text file

Download:

• obs-localvocal-0.1.0-macos-universal.pkg 70.1 MB
• obs-localvocal-0.1.0-windows-x64-Installer.exe 71.5 MB
• obs-localvocal-0.1.0-windows-x64.zip 79.9 MB
• obs-localvocal-0.1.0-x86_64-linux-gnu.deb 67.9 MB

In this release:

• Bump Whisper.cpp for another ~10% gains in speed / processing
• Add "Simple Mode" for settings so people don't run away screaming :D
• Internal shuffling that results in a more robust plugin, less crashy

Enjoy!

Download links:

• obs-localvocal-0.0.8-macos-universal.pkg 70.1 MB
• obs-localvocal-0.0.8-source.tar.xz 67.3 MB
• obs-localvocal-0.0.8-windows-x64-Installer.exe 71.5 MB
• obs-localvocal-0.0.8-windows-x64.zip 79.9 MB
• obs-localvocal-0.0.8-x86_64-linux-gnu.deb 67.9 MB

This release bumps Whisper.cpp to a version that brings ~25% gains in performance (!), and also fixing the notorious "remove filter crash" bug.
Let me know if you experience any issues!

If you'd like to support my work consider Patreon or GitHub Sponsors, a on the repo would be greatly appreciated and a rating on the OBS forum

What's Changed​

• Bump whisper version for 25% speed gains by @royshil in #51
• Add -fPIC to plugin-support on linux by @royshil in #54
• Fix destroy crash by @royshil in #55
• Bump whispercpp and fix mac build by @royshil in #56

Full Changelog: 0.0.6...0.0.7