LocalVocal: Local Live Captions & Translation On-the-Go

LocalVocal: Local Live Captions & Translation On-the-Go v0.3.9

Go to download
Overview Updates (22) Reviews (9) History Discussion

v0.3.9 - Cloud translation, No VAD option

In this release:
  • Add cloud-based translation from multiple vendors (including custom)
  • No VAD option (Whisper based VAD and segmentation)
Download
  • Like
Reactions: OpenFields

v0.3.8 - Fixes!

In this release:

  • Fix captions filename renaming after recording for non-SRT
  • Bump whisper engine to latest
  • Additional models in the directory
  • Full translations of the plugin UI
Download
  • Like
Reactions: OpenFields and Tallicia

v0.3.6 Whisper Large v3 Turbo! Super-fast and powerful model

Adding Whisper Large v3 Turbo
Bump ONNXruntime v1.19.2

Download
  • Like
Reactions: Tallicia, IDLT and OpenFields

v0.3.5 - Upgrades, improvements - the good stuff!

In this release:
  • Upgrade Silero VAD to v5
  • Upgrade to latest whisper.cpp
  • Filter words UI improvement
  • Improvements to real-time translation
  • Improvement to very short audio chunks
Enjoy!

Download:
  • Like
Reactions: Tallicia, IDLT and MilfarW

v0.3.4 AMD GPU! CoreML and Metal! Accelerate!

Much rejoicing! Introducing AMD ROCm / hipBLAS acceleration, as well as CoreML and Metal on Apple!
This was tested to give tremendous performance boosts on Apple and AMD GPUs.

Also in this release:
  • bumping to the latest whisper.cpp
  • fixing the captions stream issue on Twitch and YouTube
  • fixing the translation captions disappearance.
Enjoy and let me know of any problems!

Download:
  • Like
Reactions: IDLT, Tallicia and uuoocl

v0.3.3 Partial real-time Transcripts! new OBS, many bugfixes

In this release:
  • New simplified and streamlined filter UI, and properties refactoring
  • File output fixes
  • Model loading fixes
  • Language selection bug fix
  • Partial transcription option
  • More bugfixes
Download:
  • Like
Reactions: IDLT and OpenFields

v0.3.2 Improvements all around! Caption presentation, logs and bugfixes

Lots of things going on in this busy release!

  • Adding filter & replace option
  • Improving buffered output a lot making it much nicer (like word wrapping, word-by-word mode)
  • Improving the translation-sentence cadence
  • Fixing logs and potential crash-causing bugs

Download​

  • Like
Reactions: IDLT, uuoocl and OpenFields

v0.3.1 - more models, fix timestamps

In this release:
  • Adding more whisper model options
  • Only allowing English selection for English models
  • Freeing up resources on filter disable
  • Fixing a bug to make accurate timestamps
Download:
  • Like
Reactions: IDLT and OpenFields

v0.3.0 Big release! Far better experience, more translation, bugs squashed!

Big release! Many improvements, solving a lot of bugs and introducing far better performance.
In points:
  • VAD based segmentation - no more "3 seconds segments"! when speech is detected the transcription kicks in
  • Incremental output: The captions will appear continuously as you speak, a live transcription effect
  • Bumping the version of whisper.cpp
  • Many more options for real-time translation
  • A lot of bug fixing...
Download
  • Like
Reactions: IDLT

v0.2.6 - More robust, better translation, Linux fix

A big release. Fixing things and adding evaluation tools
  • Fixing Linux problems with missing dependency
  • Testing tools and scripts for evaluating the algorithm
  • Add Whisper-based translation
  • Add M2M100 1.2B model for translation
  • Optimizing overlap regions
  • Sentence suppression fixup
Download
  • Like
Reactions: IDLT
Top