← 返回资源分享
Controllable Sequence-To-Sequence Neural TTS with LPCNET Backend for Real-time Speech Synthesis on CPU
论文
论文
发布时间2020-02-25
发表arXiv:2002.10708
详细介绍
State-of-the-art sequence-to-sequence acoustic networks, that convert a
phonetic sequence to a sequence of spectral features with no explicit prosody
prediction, generate speech with close to natural quality, when cascaded with
neural vocoders, such as Wavenet. However, the combined system is typically too
heavy for real-time speech synthesis on a CPU. In this work we present a
sequence-to-sequence acoustic network combined with lightweight LPCNet neural
vocoder, designed for real-time speech synthesis on a CPU. In addition, the
system allows sentence-level pace and expressivity control at inference time.
We demonstrate that the proposed system can synthesize high quality 22 kHz
speech in real-time on a general-purpose CPU. In terms of MOS score degradation
relative to PCM, the system attained as low as 6.1-6.5% for quality and 6.3-
7.0% for expressiveness, reaching equivalent or better quality when compared to
a similar system with a Wavenet vocoder backend.
