Five Open Speech Models in One Drop: Ant's MIT-Licensed Ming-3.0
Ant Group's inclusionAI open-sourced the five-model Ming-3.0 speech family under MIT on 2026-10-19/20 (multi-source confirmed; self-host, fine-tune, and commercial use all allowed), covering synthesis, audio understanding and dialogue, and recognition: Ming-3.0-tts-0.5B (0.5B dense, the lightest, deployable on four cards), Ming-3.0-tts-tiny (7.9B total / 1.3B active MoE, long-form multi-speaker podcasts), Ming-3.0-audio-flash (126B total / 6.5B active MoE, audio understanding and dialogue, answering in text or speech), Ming-3.0-audio-tiny (9.3B / 2.7B, efficiency-oriented), and Ming-3.0-asr-tiny (8.6B / 2B, context-aware transcription). Capabilities: TTS with text-described voices, a director mode that controls emotion, stress, and pacing in natural language, voice cloning, seven languages plus two dialects; audio understanding takes long recordings directly with structured output, preserving emotion and speaker identity, plus tool-call generation; ASR adds dialect recognition, hotword injection, and context awareness. Setup (verified against kie.ai and the README): TTS route - git clone github.com/inclusionAI/Ming-3.0-tts, conda env (0.5B: python 3.10, pip install -r requirements.txt, conda install -c conda-forge pynini==2.1.6), run per README; tts-tiny needs its own env with Python 3.10.15, PyTorch/Torchaudio 2.7.1 (cu118), Transformers 4.46.3; audio-flash via downloaded weights or Ling Studio Chat (ling.tbox.cn), 128K context, speech output through the Chat Completions audio.voice field with modalities=["text","audio"]. Hardware: officially tested mainly on datacenter cards - recommended NVIDIA H800 (80GB) or H20 (96GB); 0.5B on four cards is the floor; consumer-GPU feasibility unverified. Day-0 ecosystem: vLLM-Omni and SGLang-Omni adapted. Internal Ant usage (official): asr-tiny in the Afu doctor assistant, Alipay Search, Yixiaobao realtime voice, and security verification. Four limitations stated as-is: no quantized files (no GGUF/AWQ/EXL2), streaming in doubt (SGLang-Omni returns a full waveform even with stream=true, so true first-audio latency is unestablished), mutually exclusive control modes (voice design, emotion, and dialect cannot combine in one call), and unpublished training data. Leaderboard backing (secondary): Artificial Analysis TTS leaderboard (Provider Voices) puts Ming-3.0-tts at 1244, near the top. Division note: voice-cloning-toolkit-comparison-review (2026-10-15) is the review-lane selection piece; this SOP lane covers hands-on setup of the five-model stack - different lanes, different angles.