LocalVocal: Local Live Captions & Translation On-the-Go v0.3.6

Adding Whisper Large v3 Turbo
Bump ONNXruntime v1.19.2

Download

• obs-localvocal-0.3.6-macos-arm64.pkg
• obs-localvocal-0.3.6-macos-x86_64.pkg
• obs-localvocal-0.3.6-windows-x64-cpu-Installer.exe
• obs-localvocal-0.3.6-windows-x64-cpu.zip
• obs-localvocal-0.3.6-windows-x64-cuda-Installer.exe
• obs-localvocal-0.3.6-windows-x64-cuda.zip
• obs-localvocal-0.3.6-windows-x64-hipblas-Installer.exe
• obs-localvocal-0.3.6-windows-x64-hipblas.zip
• obs-localvocal-0.3.6-x86_64-linux-gnu.deb
  

In this release:

• Upgrade Silero VAD to v5
• Upgrade to latest whisper.cpp
• Filter words UI improvement
• Improvements to real-time translation
• Improvement to very short audio chunks

Enjoy!

Download:

• obs-localvocal-0.3.5-macos-arm64.pkg
• obs-localvocal-0.3.5-macos-x86_64.pkg
• obs-localvocal-0.3.5-windows-x64-cpu-Installer.exe
• obs-localvocal-0.3.5-windows-x64-cpu.zip
• obs-localvocal-0.3.5-windows-x64-cuda-Installer.exe
• obs-localvocal-0.3.5-windows-x64-cuda.zip
• obs-localvocal-0.3.5-windows-x64-hipblas-Installer.exe
• obs-localvocal-0.3.5-windows-x64-hipblas.zip
• obs-localvocal-0.3.5-x86_64-linux-gnu.deb

Much rejoicing! Introducing AMD ROCm / hipBLAS acceleration, as well as CoreML and Metal on Apple!
This was tested to give tremendous performance boosts on Apple and AMD GPUs.

Also in this release:

• bumping to the latest whisper.cpp
• fixing the captions stream issue on Twitch and YouTube
• fixing the translation captions disappearance.

Enjoy and let me know of any problems!

Download:

• obs-localvocal-0.3.4-macos-arm64.pkg
• obs-localvocal-0.3.4-macos-x86_64.pkg
• obs-localvocal-0.3.4-windows-x64-cpu-Installer.exe
• obs-localvocal-0.3.4-windows-x64-cpu.zip
• obs-localvocal-0.3.4-windows-x64-cuda-Installer.exe
• obs-localvocal-0.3.4-windows-x64-cuda.zip
• obs-localvocal-0.3.4-windows-x64-hipblas-Installer.exe
• obs-localvocal-0.3.4-windows-x64-hipblas.zip
• obs-localvocal-0.3.4-x86_64-linux-gnu.deb

In this release:

• New simplified and streamlined filter UI, and properties refactoring
• File output fixes
• Model loading fixes
• Language selection bug fix
• Partial transcription option
• More bugfixes

Download:

• obs-localvocal-0.3.3-macos-arm64.pkg
• obs-localvocal-0.3.3-macos-x86_64.pkg
• obs-localvocal-0.3.3-windows-x64-cpu-Installer.exe
• obs-localvocal-0.3.3-windows-x64-cpu.zip
• obs-localvocal-0.3.3-windows-x64-cuda11.8.0-Installer.exe
• obs-localvocal-0.3.3-windows-x64-cuda11.8.0.zip
• obs-localvocal-0.3.3-windows-x64-cuda12.2.0-Installer.exe
• obs-localvocal-0.3.3-windows-x64-cuda12.2.0.zip
• obs-localvocal-0.3.3-windows-x64-cudaclblast-Installer.exe
• obs-localvocal-0.3.3-windows-x64-cudaclblast.zip
• obs-localvocal-0.3.3-x86_64-linux-gnu.deb

Lots of things going on in this busy release!

• Adding filter & replace option
• Improving buffered output a lot making it much nicer (like word wrapping, word-by-word mode)
• Improving the translation-sentence cadence
• Fixing logs and potential crash-causing bugs

Download​

• obs-localvocal-0.3.2-macos-arm64.pkg 86 MB
• obs-localvocal-0.3.2-macos-x86_64.pkg 86.5 MB
• obs-localvocal-0.3.2-windows-x64-cpu-Installer.exe 75.4 MB
• obs-localvocal-0.3.2-windows-x64-cpu.zip 86.4 MB
• obs-localvocal-0.3.2-windows-x64-cuda11.8.0-Installer.exe 330 MB
• obs-localvocal-0.3.2-windows-x64-cuda11.8.0.zip 523 MB
• obs-localvocal-0.3.2-windows-x64-cuda12.2.0-Installer.exe 337 MB
• obs-localvocal-0.3.2-windows-x64-cuda12.2.0.zip 534 MB
• obs-localvocal-0.3.2-windows-x64-cudaclblast-Installer.exe 76.1 MB
• obs-localvocal-0.3.2-windows-x64-cudaclblast.zip 88 MB
• obs-localvocal-0.3.2-x86_64-linux-gnu.deb 77.5 MB

In this release:

• Adding more whisper model options
• Only allowing English selection for English models
• Freeing up resources on filter disable
• Fixing a bug to make accurate timestamps

Download:

• obs-localvocal-0.3.1-macos-arm64.pkg 85.5 MB
• obs-localvocal-0.3.1-macos-x86_64.pkg 85.9 MB
• obs-localvocal-0.3.1-source.tar.xz 72.1 MB
• obs-localvocal-0.3.1-windows-x64-cpu-Installer.exe 75.4 MB
• obs-localvocal-0.3.1-windows-x64-cpu.zip 86.4 MB
• obs-localvocal-0.3.1-windows-x64-cuda11.8.0-Installer.exe 330 MB
• obs-localvocal-0.3.1-windows-x64-cuda11.8.0.zip 523 MB
• obs-localvocal-0.3.1-windows-x64-cuda12.2.0-Installer.exe 337 MB
• obs-localvocal-0.3.1-windows-x64-cuda12.2.0.zip 534 MB
• obs-localvocal-0.3.1-windows-x64-cudaclblast-Installer.exe 76.1 MB
• obs-localvocal-0.3.1-windows-x64-cudaclblast.zip 87.9 MB
• obs-localvocal-0.3.1-x86_64-linux-gnu.deb 77.5 MB

Big release! Many improvements, solving a lot of bugs and introducing far better performance.
In points:

• VAD based segmentation - no more "3 seconds segments"! when speech is detected the transcription kicks in
• Incremental output: The captions will appear continuously as you speak, a live transcription effect
• Bumping the version of whisper.cpp
• Many more options for real-time translation
• A lot of bug fixing...

Download

• obs-localvocal-0.3.0-macos-arm64.pkg 85.5 MB
• obs-localvocal-0.3.0-macos-x86_64.pkg 85.9 MB
• obs-localvocal-0.3.0-windows-x64-cpu-Installer.exe 75.4 MB
• obs-localvocal-0.3.0-windows-x64-cpu.zip 86.4 MB
• obs-localvocal-0.3.0-windows-x64-cuda11.8.0-Installer.exe 330 MB
• obs-localvocal-0.3.0-windows-x64-cuda11.8.0.zip 523 MB
• obs-localvocal-0.3.0-windows-x64-cuda12.2.0-Installer.exe 337 MB
• obs-localvocal-0.3.0-windows-x64-cuda12.2.0.zip 534 MB
• obs-localvocal-0.3.0-windows-x64-cudaclblast-Installer.exe 76.1 MB
• obs-localvocal-0.3.0-windows-x64-cudaclblast.zip 87.9 MB
• obs-localvocal-0.3.0-x86_64-linux-gnu.deb 77.5 MB

A big release. Fixing things and adding evaluation tools

• Fixing Linux problems with missing dependency
• Testing tools and scripts for evaluating the algorithm
• Add Whisper-based translation
• Add M2M100 1.2B model for translation
• Optimizing overlap regions
• Sentence suppression fixup

Download

• obs-localvocal-0.2.6-macos-arm64.pkg 85.3 MB
• obs-localvocal-0.2.6-macos-x86_64.pkg 85.7 MB
• obs-localvocal-0.2.6-windows-x64-cpu-Installer.exe 75.4 MB
• obs-localvocal-0.2.6-windows-x64-cpu.zip 86.3 MB
• obs-localvocal-0.2.6-windows-x64-cuda11.8.0-Installer.exe 327 MB
• obs-localvocal-0.2.6-windows-x64-cuda11.8.0.zip 514 MB
• obs-localvocal-0.2.6-windows-x64-cuda12.2.0-Installer.exe 333 MB
• obs-localvocal-0.2.6-windows-x64-cuda12.2.0.zip 526 MB
• obs-localvocal-0.2.6-windows-x64-cudaclblast-Installer.exe 76.1 MB
• obs-localvocal-0.2.6-windows-x64-cudaclblast.zip 87.9 MB
• obs-localvocal-0.2.6-x86_64-linux-gnu.deb 77.5 MB

Our BEST version of LocalVocal yet!

Bumping whisper versions, fixing buffers for smooth transitions, simplifying UI, adding suppression mechanism...
It's an overhaul...

Enjoy!

• obs-localvocal-0.2.3-macos-arm64.pkg 85.2 MB
• obs-localvocal-0.2.3-macos-x86_64.pkg 85.6 MB
• obs-localvocal-0.2.3-source.tar.xz 69 MB
• obs-localvocal-0.2.3-windows-x64-cpu-Installer.exe 75.4 MB
• obs-localvocal-0.2.3-windows-x64-cpu.zip 86.3 MB
• obs-localvocal-0.2.3-windows-x64-cuda11.8.0-Installer.exe 327 MB
• obs-localvocal-0.2.3-windows-x64-cuda11.8.0.zip 514 MB
• obs-localvocal-0.2.3-windows-x64-cuda12.2.0-Installer.exe 333 MB
• obs-localvocal-0.2.3-windows-x64-cuda12.2.0.zip 526 MB
• obs-localvocal-0.2.3-windows-x64-cudaclblast-Installer.exe 76.1 MB
• obs-localvocal-0.2.3-windows-x64-cudaclblast.zip 87.9 MB
• obs-localvocal-0.2.3-x86_64-linux-gnu.deb 77.4 MB

This version adds built-in translation for live captioning.
Translating to-and-from ~100 languages, simply by clicking a button.

Enjoy!

Download:

• obs-localvocal-0.2.1-macos-arm64.pkg 70.5 MB
• obs-localvocal-0.2.1-macos-x86_64.pkg 70.8 MB
• obs-localvocal-0.2.1-windows-x64-cpu-Installer.exe 72.2 MB
• obs-localvocal-0.2.1-windows-x64-cpu.zip 80.8 MB
• obs-localvocal-0.2.1-windows-x64-cuda11.8.0-Installer.exe 323 MB
• obs-localvocal-0.2.1-windows-x64-cuda11.8.0.zip 506 MB
• obs-localvocal-0.2.1-windows-x64-cuda12.2.0-Installer.exe 329 MB
• obs-localvocal-0.2.1-windows-x64-cuda12.2.0.zip 518 MB
• obs-localvocal-0.2.1-x86_64-linux-gnu.deb 69.2 MB