Deep Reinforcement Learning for RSMA-Based Multi-Functional Wireless Networks

The upcoming sixth generation (6G) is expected to support a wide range of applications that require efficient sensing, accurate localization, and reliable communication capabilities. Furthermore, 6G is expected to catalyze the development of new use cases that will require working in extreme environmental and hazardous conditions and have ultra-small size and low-cost wireless devices. Thus, developing sustainable multi-functional wireless networks that are capable of incorporating billions of low-power devices and supporting their sensing and communication requirements on top of energy harvesting capability is of paramount importance. Motivated by this, we consider in this work a rate-splitting multiple access (RSMA)-based multifunctional wireless network with sensing, energy harvesting, and communication capabilities. We employ trust region policy optimization (TRPO), a deep  reinforcement learning (DRL) algorithm, to efficiently allocate the available resources and manage the interference between the three functionalities. TRPO/DRL is capable to learn a near-optimal policy for the resource allocation problem in a complex and dynamic environment. This enables us to obtain near-optimal transmit precoders, power splitting ratios, and ratesplitting among the common and private rates in a multiple access setting. Simulation results demonstrate the effectiveness of RSMA in mitigating the interference in such multi-functional networks and its capability to accommodate the rate and energy harvesting requirements of the devices while still capable of sensing multiple targets.