|
|
Q-Learning Based Sensing Task Management Algorithm for Cognitive Radio Systems |
Li Mo; Xu You-yun; Cai Yue-ming |
Institute of Communications Engineering, PLA University of Science and Technology, Nanjing 210007, China |
|
|
Abstract More than an adaptive system, the cognitive radio system is an intelligent system. The Q-Learning of the intelligent control theory is adopted in the paper, to solve the sensing task allocation problem among cognitive users. And a Q-Learning based sensing management algorithm is proposed. The algorithm allocates sensing tasks to users through times of interaction with the environment and self-learning. The scheme of the paper works without any channel state information and estimation of primary traffic. From the simulation result, the algorithm could improve the sensing efficiency compared to the static allocation algorithm and attain to the convergence in a short time, which could be an attempt to the future intelligent cognitive radio systems.
|
Received: 09 March 2009
|
|
Corresponding Authors:
Li Mo
|
|
|
|
|
|
|