{"id":17935,"date":"2026-03-26T12:07:43","date_gmt":"2026-03-26T12:07:43","guid":{"rendered":"https:\/\/jobuzo.com\/en\/mistral-releases-a-new-open-source-model-for-speech-generation\/"},"modified":"2026-03-26T12:07:43","modified_gmt":"2026-03-26T12:07:43","slug":"mistral-releases-a-new-open-source-model-for-speech-generation","status":"publish","type":"post","link":"https:\/\/jobuzo.com\/en\/mistral-releases-a-new-open-source-model-for-speech-generation\/","title":{"rendered":"Mistral releases a new open-source model for speech generation"},"content":{"rendered":"<div>\n<p id=\"speakable-summary\" class=\"wp-block-paragraph\">French AI company Mistral released a new open-source text-to-speech model on Thursday that can be used by voice AI assistants or in enterprise use cases like customer support. The model, which lets enterprises build voice agents for sales and customer engagement, puts Mistral in direct competition with the likes of ElevenLabs, Deepgram, and OpenAI.<\/p>\n<p class=\"wp-block-paragraph\">The new model, called Voxtral TTS, supports nine languages, including English, French, German, Spanish, Dutch, Portuguese, Italian, Hindi, and Arabic. <\/p>\n<p class=\"wp-block-paragraph\">&ldquo;Our customers have been asking for a speech model. So we built a small-sized speech model that can fit on a smartwatch, a smartphone, a laptop, or other edge devices. The cost of it is a fraction of anything else on the market, but it offers state-of-the-art performance,&rdquo; Pierre Stock, vp of science operations at Mistral AI, told TechCrunch during a phone interview.<\/p>\n<figure class=\"wp-block-image aligncenter size-large\"><figcaption class=\"wp-element-caption\"><span class=\"wp-element-caption__text\">Image Credits: Mistral<\/span><\/figcaption><\/figure>\n<p class=\"wp-block-paragraph\">Mistral said the new model can adapt a custom voice with a sample of less than five seconds, and also capture characteristics like subtle accents, inflections, intonations, and irregularities in the flow of speech. The model, based on Ministral 3B, can switch between languages easily without losing the characteristics of the voice, which is useful for use cases like dubbing or real-time translation. Stock said the company wanted the model to sound human and not robotic.<\/p>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\">\n<p>\n[embedded content]\n<\/p>\n<\/figure>\n<p class=\"wp-block-paragraph\">The model has been built for real-time performance, according to the company. It has a time-to-first-audio (TTFA) &mdash;&nbsp;a measure of when the model starts &lsquo;speaking&rsquo; after receiving input &mdash; of 90ms for a 10-second sample of 500 characters. The model also has a real-time factor (RTF) of 6x, which means it can render a 10-second clip in roughly 1.6 seconds.<\/p>\n<figure class=\"wp-block-image aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" height=\"446\" width=\"680\" src=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?w=680\" alt class=\"wp-image-3105894\" srcset=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg 1600w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=150,98 150w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=300,197 300w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=768,504 768w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=680,446 680w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=1200,788 1200w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=1280,840 1280w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=430,282 430w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=720,473 720w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=900,591 900w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=800,525 800w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=1536,1008 1536w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=668,438 668w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=571,375 571w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=940,617 940w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=708,465 708w, https:\/\/techcrunch.com\/wp-content\/uploads\/2026\/03\/1cc0ce97-f6f1-477a-8c25-23ca793d0571.jpeg?resize=50,33 50w\" sizes=\"auto, (max-width: 680px) 100vw, 680px\"><figcaption class=\"wp-element-caption\"><span class=\"wp-element-caption__text\">Image Credits: Mistral AI<\/span><\/figcaption><\/figure>\n<div class=\"internal-linking-related-contents\"><a href=\"https:\/\/jobuzo.com\/en\/12-weeks-jail-for-school-it-support-technician-who-took-upskirt-videos-of-teachers\/\" class=\"template-1\"><span class=\"cta\">News :<\/span><span class=\"postTitle\">&lt;div&gt;12 weeks' jail for school IT support technician who took upskirt videos of teachers&lt;\/div&gt;<\/span><\/a><\/div><p class=\"wp-block-paragraph\">Earlier this year, Mistral launched a pair of transcription models, one for large batch processing and the other for real-time use cases with low latency. With the new speech model, the company is likely aiming to provide a full suite of voice products to enterprises.<\/p>\n<p class=\"wp-block-paragraph\">&ldquo;We plan to have an end-to-end platform that can handle multimodal streams of input, including audio, text, and image and output as well. The main benefit of that is you get way more information with an end-to-end agentic system that supports audio as an input or output,&rdquo; Stock said.<\/p>\n<div class=\"wp-block-techcrunch-inline-cta\">\n<div class=\"inline-cta__wrapper\" readability=\"5.7826086956522\">\n<p>Techcrunch event<\/p>\n<div class=\"inline-cta__content\" readability=\"26.153846153846\">\n<p>\n\t\t\t\t\t\t\t\t\t<span class=\"inline-cta__location\">San Francisco, CA<\/span><br>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<span class=\"inline-cta__separator\">|<\/span><br>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<span class=\"inline-cta__date\">October 13-15, 2026<\/span>\n\t\t\t\t\t\t\t<\/p>\n<\/div>\n<\/div>\n<\/div>\n<p class=\"wp-block-paragraph\">Mistral&rsquo;s positioning is that its open source and customization bit will help enterprises adopt its voice models over competitors, as they can tune it the way they want.<\/p>\n<\/div>\n<p><sub>Mistral releases a new open-source model for speech generation<\/sub><\/p>\n","protected":false},"excerpt":{"rendered":"<p>French AI company Mistral released a new open-source text-to-speech model on Thursday that can be used by voice AI assistants or in enterprise use cases like customer support. The model, which lets enterprises build voice agents for sales and customer engagement, puts Mistral in direct competition with the likes of ElevenLabs, Deepgram, and OpenAI. The&#8230;<\/p>\n<p class=\"more-link-wrap\"><a href=\"https:\/\/jobuzo.com\/en\/mistral-releases-a-new-open-source-model-for-speech-generation\/\" class=\"more-link\">Read More<span class=\"screen-reader-text\"> &ldquo;Mistral releases a new open-source model for speech generation&rdquo;<\/span> &raquo;<\/a><\/p>\n","protected":false},"author":1,"featured_media":17936,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-17935","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/jobuzo.com\/en\/wp-json\/wp\/v2\/posts\/17935","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jobuzo.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jobuzo.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jobuzo.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jobuzo.com\/en\/wp-json\/wp\/v2\/comments?post=17935"}],"version-history":[{"count":0,"href":"https:\/\/jobuzo.com\/en\/wp-json\/wp\/v2\/posts\/17935\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/jobuzo.com\/en\/wp-json\/wp\/v2\/media\/17936"}],"wp:attachment":[{"href":"https:\/\/jobuzo.com\/en\/wp-json\/wp\/v2\/media?parent=17935"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jobuzo.com\/en\/wp-json\/wp\/v2\/categories?post=17935"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jobuzo.com\/en\/wp-json\/wp\/v2\/tags?post=17935"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}