Isn't there a Text To Speech plugin for real-time text?

[oo22339]

I am currently using Closed Captioning via Google Speech Recognition 0.0.8.
This plug-in converts my voice into text in real time.
This text is entered as an OBS source and disappears after a while.
I want to convert this real-time text into AI voice and send it to the broadcast using this text source.
Is there a TTS plugin for this?
I searched, but I only see TTS plugins for donations or chatting.
Any help please?

 

[royshilkrot]

i'm going to start working on such a plugin shortly, waiting on some 3rd party library to unlock in the next couple weeks

i'm also thinking about real-time auto translation to other languages utilizing Speech-to-text -> Translation -> Text-to-speech

keep an eye out for my work and you'll hear about the new TTS plugin soon.

 

[AaronD]

I am currently using Closed Captioning via Google Speech Recognition 0.0.8.
This plug-in converts my voice into text in real time.

How accurate is it? I've seen some pretty good zingers and even some foul language from automated transcribers that was clearly not what the speaker said!

 

[royshilkrot]

Took a while! But i'm here with realtime local TTS: https://youtu.be/kltJbg9hH4s using URL/API source https://github.com/occ-ai/obs-urlsource and https://github.com/coqui-ai/TTS

 

[waayaa]

Took a while! But i'm here with realtime local TTS: https://youtu.be/kltJbg9hH4s using URL/API source https://github.com/occ-ai/obs-urlsource and https://github.com/coqui-ai/TTS

Make it plug n play

 

[deFrisselle]

i'm going to start working on such a plugin shortly, waiting on some 3rd party library to unlock in the next couple weeks

i'm also thinking about real-time auto translation to other languages utilizing Speech-to-text -> Translation -> Text-to-speech

keep an eye out for my work and you'll hear about the new TTS plugin soon.

That would be amazing

 

[royshilkrot]

Make it plug n play

It's not impossible... But I wonder how many people will.find it useful. I'd start with something more high touch and then establish a demand for it - then develop a bespoke plugin or feature.
You can join my live "office hours" stream to discuss: https://youtube.com/@royshilk?si=nmOPU9LQDnPE3b1h

 

[royshilkrot]

That would be amazing

The entire pipeline I was already able to implement in parts, so you could build a demo for it. But it's not very immediate... Still could be useful. I'm waiting to see if many people ask for something like that