loading page

Deep Contextual Bandit and Reinforcement Learning for IRS-assisted MU-MIMO Systems
  • +1
  • Dariel Pereira-Ruisánchez ,
  • Óscar Fresnedo ,
  • Darian Pérez-Adán ,
  • Luis Castedo
Dariel Pereira-Ruisánchez
CITIC Research Centre

Corresponding Author:[email protected]

Author Profile
Óscar Fresnedo
Author Profile
Darian Pérez-Adán
Author Profile
Luis Castedo
Author Profile


The combination of multiple-input multiple-output (MIMO) and intelligent reflecting surfaces (IRSs) is foreseen as a key enabler of beyond 5G (B5G) and 6G. In this work, two different approaches are considered for the joint optimization of the IRS phase-shift matrix and MIMO precoders of an IRS-assisted multi-stream (MS) multi-user MIMO (MU-MIMO) system with the aim of maximizing the system sum-rate for every channel realization. The first one is a novel contextual bandit (CB) approach with continuous state and action spaces called deep contextual bandit-oriented deep deterministic policy gradient (DCB-DDPG). The second is an innovative deep reinforcement learning (DRL) formulation where the states, actions and rewards are selected such that the Markov decision process (MDP) property of reinforcement learning (RL) is properly met. Both proposals perform remarkably better than state-of-the-art heuristic methods in high multi-user interference scenarios.
Jul 2023Published in IEEE Transactions on Vehicular Technology volume 72 issue 7 on pages 9099-9114. 10.1109/TVT.2023.3249353