overview
What is MARS5 TTS?
MARS5 TTS is a text-to-speech (TTS) tool developed by Camb.ai that enables developers and AI artists to generate highly expressive and dynamic speech. It is renowned for its ability to capture and reproduce complex prosody, emotion, and performance, particularly in challenging audio scenarios. The model converts text into natural-sounding speech using a two-stage AR-NAR pipeline, which includes an autoregressive transformer for initial speech feature encoding and a multinomial Denoising Diffusion Probabilistic Model (DDPM) for refining these features into the final audio output. This architecture allows MARS5 TTS to excel in scenarios requiring nuanced vocal delivery, such as sports commentary, anime, and dramatic narration. The open-source English version was released in June 2024, with the underlying Camb.ai API supporting over 140 languages.