VRChat Real-Time Speech Translator

Back to projects
VRChat Real-Time Speech Translator
In Development
C#/.NET/WPF/Azure Speech/DeepL/OSC

A Windows desktop app that transcribes your speech, translates it and posts it to the VRChat Chatbox in real time.

Project description

  • From speech to Chatbox in real time: captures the microphone, transcribes with streaming recognition, translates each finished sentence and posts it to the VRChat Chatbox over OSC.
  • Failures reported, never posted: temporary errors are retried within a time limit. Anything that can't be translated cleanly or doesn't fit the Chatbox is reported to the user instead of sent as a broken message.
  • Providers swappable behind clear boundaries: the UI only starts and stops a session. Recognition, translation and delivery each sit behind an interface, so a provider can be replaced without touching the rest, and every push and pull request runs 413 tests on Windows CI.
  • Keys and transcripts kept private: API keys are encrypted at rest, and logs never record credentials, audio or what was said.

The code is private, so this page stays high level. I’m happy to walk through it in person though :).

Profile Image of the Author
nonameTAT
olleH :)
Site Statistics
Posts
2
Total Words
3,039
Running Days
0 days
Last Activity
0 days ago
Site Info
Build Platform
GitHub Actions
Blog Version
Firefly v6.16.9
License
All Rights Reserved
Table of Contents