Implications of the Dirichlet assumption for discretization of continuous variables in naive Bayesian classifiers
檔案
- 000186206000002.pdf (225.0 KB, Adobe PDF)
日期
2003-12-01
類型
系所
期刊名稱
MACHINE LEARNING
卷期與頁次
第 53 卷第 3 期,頁 235–263
ISSN
0885-6125
語言
英文
摘要
In a naive Bayesian classifier, discrete variables as well as discretized continuous variables are assumed to have Dirichlet priors. This paper describes the implications and applications of this model selection choice. We start by reviewing key properties of Dirichlet distributions. Among these properties, the most important one is "perfect aggregation," which allows us to explain why discretization works for a naive Bayesian classifier. Since perfect aggregation holds for Dirichlets, we can explain that in general, discretization can outperform parameter estimation assuming a normal distribution. In addition, we can explain why a wide variety of well-known discretization methods, such as entropy-based, ten-bin, and bin-log l, can perform well with insignificant difference. We designed experiments to verify our explanation using synthesized and real data sets and showed that in addition to well-known methods, a wide variety of discretization methods all perform similarly. Our analysis leads to a lazy discretization method, which discretizes continuous variables according to test data. The Dirichlet assumption implies that lazy methods can perform as well as eager discretization methods. We empirically confirmed this implication and extended the lazy method to classify set-valued and multi-interval data with a naive Bayesian classifier.
關鍵詞
naive Bayesian classifiersDirichlet distributionsperfect aggregationcontinuous variablesdiscretizationlazy discretizationinterval data所屬典藏
期刊論文引用此條目
Hsu, C., Huang, H., & Wong, T. (2003). Implications of the Dirichlet assumption for discretization of continuous variables in naive Bayesian classifiers. MACHINE LEARNING, 53(3), 235–263. https://doi.org/10.1023/A:1026367023636
引用文字依 APA 第 7 版格式自動產生,使用前請再核對。
分享
永久網址:https://ir.lib.nycu.edu.tw/handle/11536/27341