A Q-learning Based Approach to Spectral Efficiency Maximization in Multiservice Wireless Systems

• Main Author: Saraiva, Juno Vitorino
• Publication Date: 2019
• Other Authors: Monteiro, Victor Farias, Lima, Francisco Rafael Marques, Maciel, Tarcísio Ferreira, Cavalcanti, Francisco Rodrigo Porto
• Format: Conference object
• Language: por
• Source: Repositório Institucional da Universidade Federal do Ceará (UFC)
• dARK ID: ark:/83112/0013000030fwq
• Download full: http://www.repositorio.ufc.br/handle/riufc/60409
• topic: Radio resource allocation; Satisfaction guarantees; Machine learning; Reinforcement learning; Q-Learning

In this article, we study Radio Resource Allocation (RRA) as a non-convex optimization problem, aiming at maximizing the spectral efficiency subject to satisfaction guarantees in multiservice wireless systems. This problem has already been previously investigated and efficient heuristics have been proposed. However, in order to assess the performance of Machine Learning (ML) algorithms when solving optimization problems in the context of RRA, we revisit that problem and propose a solution based on a Reinforcement Learning (RL) framework. Specifically, our proposal is based on the Q-learning technique, where an agent gradually learns a policy by interacting with its local environment, until reaching convergence. Thus, in this article, the task of searching for an optimal solution in a combinatorial optimization problem is transformed into finding an optimal policy in Q-learning. Lastly, through computational simulations we compare the state-of-art proposals of the literature with our approach and we show a near optimal performance of the latter for a well-trained agent.