Csiszar's cutoff rates for the general hypothesis testing problem
檔案
- 000220475700009.pdf (758.2 KB, Adobe PDF)
日期
2004-04-01
系所
期刊名稱
IEEE TRANSACTIONS ON INFORMATION THEORY
卷期與頁次
第 50 卷第 4 期,頁 663–678
ISSN
0018-9448
語言
英文
摘要
In [6], Csiszar established the concept of forward beta-cutoff rate for the error exponent hypothesis testing problem based on independent and identically distributed (i.i.d.) observations. Given beta < 0, he defined the forward beta-cutoff rate as the number R-0 greater than or equal to 0 that provides the best possible lower bound in the form beta(E - (R) over bar (0)) to the type 1 error exponent function for hypothesis testing where 0 < E < R-0 is the rate of exponential convergence to 0 of the type 2 error probably. He then demonstrated that the forward beta-cutoff rate is given by where D1/(1-beta)(Xparallel to(X) over bar) denotes the Renyi alpha-divergence [19], alpha > 0, alpha not equal 1. Similarly, for 0 < beta < 1, Csiszar also established the concept of reverse beta-cutoff rate for the correct exponent hypothesis testing problem. In this work, we extend Csiszar's results by investigating the forward and reverse beta-cutoff rates for the hypothesis testing between two arbitrary sources with memory. We demonstrate that the lim inf Renyi a-divergence rate provides the expression for the forward beta-cutoff rate. We also show that if the log-likelihood large deviation spectrum admits a limit, then the reverse beta-cutoff rate equals the liminf a-divergence rate, where alpha and 1/1-beta and 0 < beta < beta(max), where beta(max) is the largest beta < 1 for which the lim inf 1/1-beta-divergence rate is finite. For beta(max) less than or equal to beta < 1, we show that the reverse cutoff rate is in general only upper-bounded by the lim inf Renyi divergence rate. Unlike in [4], where the alphabet for the source coding cutoff rate problem was assumed to be finite, we assume arbitrary (countable or continuous) source alphabet. We also provide several examples to illustrate our forward and reverse beta-cutoff rates results and the techniques employed to establish them.
關鍵詞
alpha-divergence ratearbitrary sources with memoryforward and reverse cutoff rateshypothesis testing error and correct exponentsinformation spectrumlarge deviation theory所屬典藏
會議論文引用此條目
Alajaji, F., Chen, P., & Rached, Z. (2004). Csiszar's cutoff rates for the general hypothesis testing problem. IEEE TRANSACTIONS ON INFORMATION THEORY, 50(4), 663–678. https://doi.org/10.1109/TIT.2004.825040
引用文字依 APA 第 7 版格式自動產生,使用前請再核對。
分享
永久網址:https://ir.lib.nycu.edu.tw/handle/11536/26890