audio

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

GUI for a Vocal Remover that uses Deep Neural Networks.

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

A PyTorch-based Speech Toolkit

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

Speech recognition module for Python, supporting several engines and APIs, online and offline.

Python library for audio and music analysis

Code for the paper "Jukebox: A Generative Model for Music"

Automagically synchronize subtitles with video.

Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications

A lightweight yet powerful audio-to-MIDI converter with pitch bend detection

Picard is a cross-platform music tagger powered by the MusicBrainz database

MediaCMS is a modern, fully featured open source video and media CMS

Noise supression using deep filtering

An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Speaker Extraction, etc.

An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

Stable diffusion for real-time music generation

[ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal