標題: Modeling of Speaking Rate Influences on Mandarin Speech Prosody and Its Application to Speaking Rate-controlled TTS
作者: Chen, Sin-Horng
Hsieh, Chiao-Hua
Chiang, Chen-Yu
Hsiao, Hsi-Chun
Wang, Yih-Ru
Liao, Yuan-Fu
Yu, Hsiu-Min
電機工程學系
Department of Electrical and Computer Engineering
關鍵字: Mandarin prosody modeling;speaking rate modeling;speaking rate-controlled TTS
公開日期: 1-Jul-2014
摘要: A new data-driven approach to building a speaking rate-dependent hierarchical prosodic model (SR-HPM), directly from a large prosody-unlabeled speech database containing utterances of various speaking rates, to describe the influences of speaking rate on Mandarin speech prosody is proposed. It is an extended version of the existing HPM model which contains 12 sub-models to describe various relationships of prosodic-acoustic features of speech signal, linguistic features of the associated text, and prosodic tags representing the prosodic structure of speech. Two main modifications are suggested. One is designing proper normalization functions from the statistics of the whole database to compensate the influences of speaking rate on all prosodic-acoustic features. Another is modifying the HPM training to let its parameters be speaking-rate dependent. Experimental results on a large Mandarin read speech corpus showed that the parameters of the SR-HPM together with these feature normalization functions interpreted the effects of speaking rate on Mandarin speech prosody very well. An application of the SR-HPM to design and implement a speaking rate-controlled Mandarin TTS system is demonstrated. The system can generate natural synthetic speech for any given speaking rate in a wide range of 3.4-6.8 syllables/sec. Two subjective tests, MOS and preference test, were conducted to compare the proposed system with the popular HTS system. The MOS scores of the proposed system were in the range of 3.58-3.83 for eight different speaking rates, while they were in 3.09-3.43 for HTS. Besides, the proposed system had higher preference scores (49.8%-79.6%) than those (9.8%-30.7%) of HTS. This confirmed the effectiveness of the speaking rate control method of the proposed TTS system.
URI: http://dx.doi.org/10.1109/TASLP.2014.2321482
http://hdl.handle.net/11536/24622
ISSN: 2329-9290
DOI: 10.1109/TASLP.2014.2321482
期刊: IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING
Volume: 22
Issue: 7
起始頁: 1158
結束頁: 1171
Appears in Collections:Articles


Files in This Item:

  1. 000338122000005.pdf

If it is a zip file, please download the file and unzip it, then open index.html in a browser to view the full text content.