Best free open-source AI voice, speech and audio tools
The 60 most-starred voice & audio repos on GitHub. Stars and activity are verified from the GitHub API and updated every night.
Updated · data refreshed nightly from GitHub
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Robust Speech Recognition via Large-Scale Weak Supervision
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
Get your documents ready for gen AI
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
Clone a voice in 5 seconds to generate arbitrary speech in real-time
The open-source AI voice studio. Clone, dictate, create.
Port of OpenAI's Whisper model in C/C++
A generative speech model for daily dialogue.
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
Easily train a good VC model with voice data <= 10 mins!
🚀Clone a voice in 5 seconds to generate arbitrary speech in real-time
SOTA Open Source TTS
GUI for a Vocal Remover that uses Deep Neural Networks.
Faster Whisper transcription with CTranslate2
WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable mu
Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Generate audiobooks from e-books, voice cloning & 1158+ languages!
Translate the video from one language to another and embed dubbing & subtitles.
A TTS model capable of generating ultra-realistic dialogue in one pass.
Netflix-level subtitle cutting, translation, alignment, and even dubbing - one-click fully automated AI video subtitle team | Netflix级字幕切割、翻译、对齐、甚至加上配音，一键全自动视频搬运AI字幕组
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
Music streaming solution that works.
Open Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Daily and the community.
Open-source State-of-the-art TTS model which runs on a CPU 😻
Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android
Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"
Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node
Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isola
An opinionated CLI to transcribe Audio files w/ Whisper on-device! Powered by 🤗 Transformers, Optimum & flash-attn
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation a
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
Use Microsoft Edge's online text-to-speech service from Python WITHOUT needing Microsoft Edge
A PyTorch-based Speech Toolkit
Foundational Models for State-of-the-Art Speech and Text Translation
Very low latency speech to text, intent recognition, and text to speech, for building voice agents and interfaces
Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.
OpenAI, GPT 6.1, GPT-Image-2, Whisper API clients for Go. Zero-dependency.
Open source real-time translation app for Android that runs locally
Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio,
End-to-End Speech Processing Toolkit
Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
Lab Materials for MIT 6.S191: Introduction to Deep Learning
vits2 backbone with multilingual-bert
Generate audiobooks from e-books
EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine
A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
Transcribe on your own!
一个简单的本地网页界面，使用ChatTTS将文字合成为语音，同时支持对外提供API接口。A simple native web interface that uses ChatTTS to synthesize text into speech, along with support for external API interfaces.
eSpeak NG is an open source speech synthesizer that supports more than hundred languages and accents.
An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Conversations with GenAI
Facebook AI Research's Automatic Speech Recognition Toolkit
On-device Speech AI for Apple Silicon
Towards Human-Sounding Speech