UAV Trajectory, User Association, and Power Control for Multi-UAV-Enabled Energy-Harvesting Communications: Offline Design and Online Reinforcement Learning

Chien Wei Fu, Meng Lin Ku, Yu Jia Chen, Tony Q.S. Quek

研究成果: Article同行評審

2 引文 斯高帕斯(Scopus)

摘要

In this article, we consider multiple solar-powered wireless nodes (WNs) which utilize the harvested solar energy to transmit collected data to multiple unmanned aerial vehicles (UAVs) in the uplink. In this context, we jointly design UAV flight trajectories, UAV-node user association, and uplink power control to effectively utilize the harvested energy and manage co-channel interference within a finite time horizon. The design goal is to ensure the fairness of WNs by maximizing the worst user rate. The joint design problem is highly nonconvex and requires causal (future) knowledge of the instantaneous energy state information (ESI) and channel state information (CSI), which are difficult to predict in reality. To overcome these challenges, we propose an offline method based on convex optimization that only utilizes the average ESI and CSI, where line-of-sight (LOS) and non-LOS (NLOS) channels are considered. The problem is solved by three convex subproblems with successive convex approximation (SCA) and alternative optimization. We further design an online convex-assisted reinforcement learning (CARL) method based on real-time environmental information. An idea of multi-UAV regulated flight corridors, based on the optimal offline UAV trajectories, is proposed to avoid unnecessary flight exploration by UAVs and enables us to improve the learning efficiency and system performance, as compared with the conventional reinforcement learning (RL) method. Computer simulations are used to verify the effectiveness of the proposed methods. The proposed CARL method provides 25% and 12% improvement on the worst user rate over the offline and conventional RL methods.

原文English
頁(從 - 到)9781-9800
頁數20
期刊IEEE Internet of Things Journal
11
發行號6
DOIs
出版狀態Published - 2024 3月 15

All Science Journal Classification (ASJC) codes

  • 訊號處理
  • 資訊系統
  • 硬體和架構
  • 電腦科學應用
  • 電腦網路與通信

指紋

深入研究「UAV Trajectory, User Association, and Power Control for Multi-UAV-Enabled Energy-Harvesting Communications: Offline Design and Online Reinforcement Learning」主題。共同形成了獨特的指紋。

引用此