標題: A Q-learning-based multi-rate transmission control scheme for RRC in WCDMA systems
作者: Ren, FC
Chang, CJ
Chen, YS
交大工研院聯合研發中心
NCTU/ITRI Joint Research Center
關鍵字: multi-rate transmission;radio resource management;Q-learning;CDMA communication system
公開日期: 1-一月-2002
摘要: In this paper, a Q-learning-based multi-rate transmission control scheme (Q-MRTC) for radio resource control (RRC) in WCDMA systems is proposed. The RRC problem is modelled as a semi-Markov decision process (SMDP). And we successfully apply a real-time reinforcement learning algorithm, named Q-learning, to accurately estimate the transmission cost for the multi-rate transmission control. For the cost function approximation, we apply the feature extraction method to map the original state space into a more compact set which represents the resultant interference profile. Simulation results show that the Q MRTC can achieve higher system throughput and better users' satisfaction index, by an amount of 87% and 50%, respectively, than the interference-based multi-rate transmission control scheme, while keeping the QoS requirement.
URI: http://dx.doi.org/10.1109/PIMRC.2002.1045263
http://hdl.handle.net/11536/150558
DOI: 10.1109/PIMRC.2002.1045263
期刊: 13TH IEEE INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, VOL 1-5, PROCEEDINGS: SAILING THE WAVES OF THE WIRELESS OCEANS
起始頁: 1422
結束頁: 1426
顯示於類別:會議論文