BAYESIAN NONPARAMETRIC LANGUAGE MODELS
檔案
本條目沒有附加檔案。
日期
2012
類型
系所
期刊名稱
2012 8TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING
卷期與頁次
頁 188–192
ISBN
978-1-4673-2507-3
語言
英文
摘要
Backoff smoothing and topic modeling are crucial issues in n-gram language model. This paper presents a Bayesian non-parametric learning approach to tackle these two issues. We develop a topic-based language model where the numbers of topics and n-grams are automatically determined from data. To cope with this model selection problem, we introduce the nonparametric priors for topics and backoff n-grams. The infinite language models are constructed through the hierarchical Dirichlet process compound Pitman-Yor (PY) process. We develop the topic-based hierarchical PY language model (THPY-LM) with power-law behavior. This model can be simplified to the hierarchical PY (HPY) LM by disregarding the topic information and also the modified Kneser-Ney (MKN) LM by further disregarding the Bayesian treatment. In the experiments, the proposed THPY-LM outperforms state-of-art methods using MKN-LM and HPY-LM.
所屬典藏
會議論文引用此條目
Chang, Y.-L., & Chien, J.-T. (2012). BAYESIAN NONPARAMETRIC LANGUAGE MODELS. 2012 8TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING, 188–192. https://ir.lib.nycu.edu.tw/handle/11536/21520
引用文字依 APA 第 7 版格式自動產生,使用前請再核對。
分享
永久網址:https://ir.lib.nycu.edu.tw/handle/11536/21520