References

DelightfulTTS

The DelightfulTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2021

DelightfulTTS Model

The core module for the training.

Acoustic Model

AcousticModel class represents a PyTorch module for an acoustic model in text-to-speech (TTS). The acoustic model is responsible for predicting speech signals from phoneme sequences.

The model comprises multiple sub-modules including encoder, decoder and various prosody encoders and predictors. Additionally, a pitch and length adaptor are instantiated.

Reference Encoder

Similar to Tacotron model, the reference encoder is used to extract the high-level features from the reference

Convolution Blocks

This part of the code responsible for the convolution blocks used in the model. Based on the FastSpeech models from FastSpeech: Fast, Robust and Controllable Text to Speech by Yi Ren et al and FastSpeech 2: Fast and High-Quality End-to-End Text to Speech by Yi Ren et al.

Attention

Attention mechanizm used in the model. The concept of "global style tokens" (GST) was introduced in Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesis by Yuxuan Wang et al.