Categories: FAANG

Improving the Quality of Neural TTS Using Long-form Content and Multi-speaker Multi-style Modeling

Neural text-to-speech (TTS) can provide quality close to natural speech if an adequate amount of high-quality speech material is available for training. However, acquiring speech data for TTS training is costly and time-consuming, especially if the goal is to generate different speaking styles. In this work, we show that we can transfer speaking style across speakers and improve the quality of synthetic speech by training a multi-speaker multi-style (MSMS) model with long-form recordings, in addition to regular TTS recordings. In particular, we show that 1) multi-speaker modeling improves the…
AI Generated Robotic Content

Recent Posts

Omnigen 2 is out

It's actually been out for a few days but since I haven't found any discussion…

17 hours ago

From fear to fluency: Why empathy is the missing ingredient in AI rollouts

Empathy and trust are not optional. They are essential for scaling change and encouraging innovation,…

18 hours ago

What Satellite Images Reveal About the US Bombing of Iran’s Nuclear Sites

The US concentrated its attack on Fordow, an enrichment plant built hundreds of feet underground.…

18 hours ago

Half of today’s jobs could vanish—Here’s how smart countries are future-proofing workers

AI is revolutionizing the job landscape, prompting nations worldwide to prepare their workforces for dramatic…

18 hours ago

Spline Path Control v2 – Control the motion of anything without extra prompting! Free and Open Source

Here's v2 of a project I started a few days ago. This will probably be…

2 days ago

STARFlow: Scaling Latent Normalizing Flows for High-resolution Image Synthesis

We present STARFlow, a scalable generative model based on normalizing flows that achieves strong performance…

2 days ago