BAYESIAN NONPARAMETRIC LANGUAGE MODELS

檔案

本條目沒有附加檔案。

日期

2012

期刊名稱

2012 8TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING

卷期與頁次

頁 188–192

ISBN

978-1-4673-2507-3

語言

英文

摘要

Backoff smoothing and topic modeling are crucial issues in n-gram language model. This paper presents a Bayesian non-parametric learning approach to tackle these two issues. We develop a topic-based language model where the numbers of topics and n-grams are automatically determined from data. To cope with this model selection problem, we introduce the nonparametric priors for topics and backoff n-grams. The infinite language models are constructed through the hierarchical Dirichlet process compound Pitman-Yor (PY) process. We develop the topic-based hierarchical PY language model (THPY-LM) with power-law behavior. This model can be simplified to the hierarchical PY (HPY) LM by disregarding the topic information and also the modified Kneser-Ney (MKN) LM by further disregarding the Bayesian treatment. In the experiments, the proposed THPY-LM outperforms state-of-art methods using MKN-LM and HPY-LM.

所屬典藏

會議論文
顯示完整詮釋資料 統計資料

引用此條目

Chang, Y.-L., & Chien, J.-T. (2012). BAYESIAN NONPARAMETRIC LANGUAGE MODELS. 2012 8TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING, 188–192. https://ir.lib.nycu.edu.tw/handle/11536/21520

BibTeX RIS

引用文字依 APA 第 7 版格式自動產生,使用前請再核對。

分享

永久網址:https://ir.lib.nycu.edu.tw/handle/11536/21520