Title: Modeling of Speaking Rate Influences on Mandarin Speech Prosody and Its Application to Speaking Rate-controlled TTS
Authors: Chen, Sin-Horng
Hsieh, Chiao-Hua
Chiang, Chen-Yu
Hsiao, Hsi-Chun
Wang, Yih-Ru
Liao, Yuan-Fu
Yu, Hsiu-Min
電機工程學系
Department of Electrical and Computer Engineering
Keywords: Mandarin prosody modeling;speaking rate modeling;speaking rate-controlled TTS
Issue Date: 1-Jul-2014
Abstract: A new data-driven approach to building a speaking rate-dependent hierarchical prosodic model (SR-HPM), directly from a large prosody-unlabeled speech database containing utterances of various speaking rates, to describe the influences of speaking rate on Mandarin speech prosody is proposed. It is an extended version of the existing HPM model which contains 12 sub-models to describe various relationships of prosodic-acoustic features of speech signal, linguistic features of the associated text, and prosodic tags representing the prosodic structure of speech. Two main modifications are suggested. One is designing proper normalization functions from the statistics of the whole database to compensate the influences of speaking rate on all prosodic-acoustic features. Another is modifying the HPM training to let its parameters be speaking-rate dependent. Experimental results on a large Mandarin read speech corpus showed that the parameters of the SR-HPM together with these feature normalization functions interpreted the effects of speaking rate on Mandarin speech prosody very well. An application of the SR-HPM to design and implement a speaking rate-controlled Mandarin TTS system is demonstrated. The system can generate natural synthetic speech for any given speaking rate in a wide range of 3.4-6.8 syllables/sec. Two subjective tests, MOS and preference test, were conducted to compare the proposed system with the popular HTS system. The MOS scores of the proposed system were in the range of 3.58-3.83 for eight different speaking rates, while they were in 3.09-3.43 for HTS. Besides, the proposed system had higher preference scores (49.8%-79.6%) than those (9.8%-30.7%) of HTS. This confirmed the effectiveness of the speaking rate control method of the proposed TTS system.
URI: http://dx.doi.org/10.1109/TASLP.2014.2321482
http://hdl.handle.net/11536/24622
ISSN: 2329-9290
DOI: 10.1109/TASLP.2014.2321482
Journal: IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING
Volume: 22
Issue: 7
Begin Page: 1158
End Page: 1171
Appears in Collections:Articles


Files in This Item:

  1. 000338122000005.pdf

If it is a zip file, please download the file and unzip it, then open index.html in a browser to view the full text content.