標題: Q-learning-based multirate transmission control scheme for RRM in multimedia WCDMA systems
作者: Chen, YS
Chang, CJ
Ren, FC
交大名義發表
National Chiao Tung University
關鍵字: code-division multiple access (CDMA) commumication system;multirate transmission;Q-learning;radio resource management
公開日期: 1-一月-2004
摘要: In this paper, a Q-learning-based multirate transmission control (Q-MRTC) scheme for radio resource management in multimedia wide-band code-division multiple access. (WCDMA) communication systems is proposed. The multirate transmission control problem is modeled as a Markov decision process where the transmission cost is defined in terms of the quality-of-service (QoS) parameters for enhancing spectrum utilization subject to QoS constraint. We adopt a real-time reinforcement learning algorithm, called Q-learning, to accurately estimate the transmission cost for the MRTC. In the meantime,we successfully employ the feature extraction method and radial basis function network (RBFN) for the Q-function that maps the original state space into a feature vector that represents the resultant interference profile. The state space and memory-storage requirement are then reduced and the convergence property of the Q-learning algorithm is improved. Simulation results show that the Q-MRTC for a multimedia WCDMA system can achieve higher system throughput by an amount of 80% and better users' satisfaction than the interference-based MRTC scheme, while the QoS requirements are guaranteed. Also, compared to the table-lookup method, the storage requirement is reduced by 41%.
URI: http://dx.doi.org/10.1109/TVT.2003.822330
http://hdl.handle.net/11536/27169
ISSN: 0018-9545
DOI: 10.1109/TVT.2003.822330
期刊: IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY
Volume: 53
Issue: 1
起始頁: 38
結束頁: 48
顯示於類別:期刊論文


文件中的檔案:

  1. 000188465400006.pdf

若為 zip 檔案,請下載檔案解壓縮後,用瀏覽器開啟資料夾中的 index.html 瀏覽全文。