← 返回资源分享
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions
论文
论文
发布时间2017-12-16
发表arXiv:1712.05884
作者:Yu Zhang,Ron J. Weiss,Jonathan Shen,Zhifeng Chen,Ruoming Pang,Yonghui Wu,RJ Skerry-Ryan,Yuxuan Wang,Rif A. Saurous,Navdeep Jaitly,Mike Schuster,Zongheng Yang,Yannis Agiomyrgiannakis
详细介绍
This paper describes Tacotron 2, a neural network architecture for speech
synthesis directly from text. The system is composed of a recurrent
sequence-to-sequence feature prediction network that maps character embeddings
to mel-scale spectrograms, followed by a modified WaveNet model acting as a
vocoder to synthesize timedomain waveforms from those spectrograms. Our model
achieves a mean opinion score (MOS) of $4.53$ comparable to a MOS of $4.58$ for
professionally recorded speech. To validate our design choices, we present
ablation studies of key components of our system and evaluate the impact of
using mel spectrograms as the input to WaveNet instead of linguistic, duration,
and $F_0$ features. We further demonstrate that using a compact acoustic
intermediate representation enables significant simplification of the WaveNet
architecture.
代码仓库 (31)
bfs18/tacotron2官方PyTorch
PaddlePaddle/PaddleSpeech官方PaddlePaddle
coqui-ai/TTSPyTorch
s3nh/pytorch-tacotron2PyTorch
anandaswarup/TTSPyTorch
dipjyoti92/SC-WaveRNNPyTorch
rosinality/melgan-pytorchPyTorch
izzajalandoni/tts_modelsPyTorch
xinshengwang/Tacotron-pytorchPyTorch
Rayhane-mamah/Tacotron-2TensorFlow
