Optimizing Dual-Mode UAV-Assisted Remote IoT Data Collection with Decentralized DRL in 6G-Enabled Space-Air-Ground Networks

Abstract

As sixth-generation (6G) networks extend to remote regions, efficient data collection from Internet of Things (IoT) devices faces challenges such as limited infrastructure, diverse latency requirements, and energy constraints. To address these, we propose a dual-mode data transmission strategy: (1) a UAV-satellite network for real-time delay-sensitive data, where wireless power transfer (WPT) is introduced to alleviate energy depletion caused by frequent data transmission, and a deadline τ<inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">max</inf> is set in each timeslot to maintain data freshness. (2) a carry-store mode for delay-tolerant data. Both aim to minimize energy consumption while maximizing data collection. Specifically, we develop a time scheduling policy to allocate data and energy transmission time for delay-sensitive data within τ<inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">max</inf>, and propose a novel centralized control, distributed execution framework using decentralized deep reinforcement learning (DRL), termed DRL-Schedule, designed to optimize UAV navigation and ensure energy-efficient, timely data collection. Simulation results demonstrate that DRL-Schedule achieves an average improvement of approximately 11.2% and 12.8% over the best baseline PPO in energy efficiency, when varying different number of UAVs and IoTs, respectively, and notably surpassing GA, Greedy and Random.