標題: Hierarchical prosody modeling for Mandarin spontaneous speech
作者: Lin, Cheng-Hsien
You, Chung-Long
Chiang, Chen-Yu
Wang, Yih-Ru
Chen, Sin-Horng
電機工程學系
Department of Electrical and Computer Engineering
公開日期: 1-四月-2019
摘要: In this paper, a hierarchical prosody model (HPM)-based method for Mandarin spontaneous speech is proposed. First, an HPM is designed for describing relations among acoustic features of utterances, linguistic features of texts, and prosodic tags representing the underlying hierarchical prosodic structures of utterances. Subsequently, a sequential optimization algorithm is employed to train the HPM based on a large conversational speech corpus, the Mandarin Conversational Dialogue Corpus (MCDC), which features orthographic transcriptions and prosodic event annotations. In this unsupervised training method, all utterances of the MCDC are labeled with two types of prosodic tags, namely, break and prosodic states, automatically and simultaneously. After training, the HPM parameters are examined to identify critical prosodic properties of Mandarin spontaneous speech, which are then compared with their counterparts in the read-speech HPM. The prosodic tags on the studied utterances enable mapping of various prosodic events onto the hierarchical prosodic structures of the utterances. Prosodic analyses of some disfluent events are conducted using the prosodic tags affixed to the MCDC. Finally, an application of the HPM to assist in Mandarin spontaneous-speech recognition is discussed. Significant relative error rate reductions of 9.0%, 9.2%, 15.6%, and 7.3% are obtained for base-syllable, character, tone, and word recognition, respectively. (C) 2019 Acoustical Society of America.
URI: http://dx.doi.org/10.1121/1.5099263
http://hdl.handle.net/11536/151945
ISSN: 0001-4966
DOI: 10.1121/1.5099263
期刊: JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA
Volume: 145
Issue: 4
起始頁: 2576
結束頁: 2596
顯示於類別:期刊論文