標題: Stochastic Recurrent Neural Network for Speech Recognition
作者: Chien, Jen-Tzung
Shen, Chen
電機工程學系
Department of Electrical and Computer Engineering
關鍵字: neural network;variational inference;stochastic error backpropagation;speech recognition
公開日期: 1-Jan-2017
摘要: This paper presents a new stochastic learning approach to construct a latent variable model for recurrent neural network (RNN) based speech recognition. A hybrid generative and discriminative stochastic network is implemented to build a deep classification model. In the implementation, we conduct stochastic modeling for hidden states of recurrent neural network based on the variational auto-encoder. The randomness of hidden neurons is represented by the Gaussian distribution with mean and variance parameters driven by neural weights and learned from variational inference. Importantly, the class labels of input speech frames are incorporated to regularize this deep model to sample the informative and discriminative features for reconstruction of classification outputs. We accordingly propose the stochastic RNN (SRNN) to reflect the probabilistic property in RNN classification system. A stochastic error backpropagation algorithm is implemented. The experiments on speech recognition using TIMIT and Aurora4 show the merit of the proposed SRNN.
URI: http://dx.doi.org/10.21437/Interspeech.2017-856
http://hdl.handle.net/11536/150996
ISSN: 2308-457X
DOI: 10.21437/Interspeech.2017-856
期刊: 18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION
起始頁: 1313
結束頁: 1317
Appears in Collections:Conferences Paper