Hierarchical Cross-Domain Satellite Resource Management: An Intelligent Collaboration Perspective

The expansion of satellite applications induces the formation of the multi-domain satellite system (MDSS) containing multiple domains with specific applications such as earth resource remote sensing and the Internet of remote things. Resource management is pivotal in enhancing the scheduling capability of the MDSS. However, this is challenging since the dynamic buffer space and communication opportunity, as well as the uncertain data traffic, exacerbate the difficulty of matching satellite resources with data traffic. Moreover, the coexistence of resource competition and collaboration across domains aggravates the dilemma of cross-domain collaboration. In this paper, we propose a hierarchical cross-domain collaborative resource management framework that can flexibly allocate the mission data through local intra-domain and global cross-domain scheduling. Then, to match the uncertain demands of missions with dynamic and limited resources, we propose a multi-agent reinforcement learning-based resource management method to guide collaboration for multi-satellite data carry-forward in a domain. Further, considering resource competition and collaboration in MDSS, we propose a domain-satellite nested matching game data scheduling algorithm to achieve pair-wise stable collaboration of cross-domain satellites. The simulation results indicate that the proposed algorithm improves the amount of offloaded data by 64.4% and 12.7% compared to the non-collaborative and the non-cross-domain schemes, respectively.

[1]  Gaofeng Cui,et al.  Joint Data Downloading and Resource Management for Small Satellite Cluster Networks , 2022, IEEE Transactions on Vehicular Technology.

[2]  Zhu Han,et al.  Cost-Efficient Beam Management and Resource Allocation in Millimeter Wave Backhaul HetNets With Hybrid Energy Supply , 2021, IEEE Transactions on Wireless Communications.

[3]  Min Sheng,et al.  Gateway Placement in Integrated Satellite–Terrestrial Networks: Supporting Communications and Internet of Remote Things , 2021, IEEE Internet of Things Journal.

[4]  Nei Kato,et al.  Optimizing Computation Offloading in Satellite-UAV-Served 6G IoT: A Deep Learning Approach , 2021, IEEE Network.

[5]  Hao Wu,et al.  QoS Provisioning in Space Information Networks: Applications, Challenges, Architectures, and Solutions , 2021, IEEE Network.

[6]  Aijun Liu,et al.  Max Completion Time Optimization for Internet of Things in LEO Satellite-Terrestrial Integrated Networks , 2021, IEEE Internet of Things Journal.

[7]  Fabrizio Granelli,et al.  A Survey on Technologies, Standards and Open Challenges in Satellite IoT , 2021, IEEE Communications Surveys & Tutorials.

[8]  Zhetao Li,et al.  Time-Varying Resource Graph Based Resource Model for Space-Terrestrial Integrated Networks , 2021, IEEE INFOCOM 2021 - IEEE Conference on Computer Communications.

[9]  Shu Fu,et al.  Collaborative Multi-Resource Allocation in Terrestrial-Satellite Network Towards 6G , 2021, IEEE Transactions on Wireless Communications.

[10]  Kwai-Sang Chin,et al.  Adaptive Metro Service Schedule and Train Composition With a Proximal Policy Optimization Approach Based on Deep Reinforcement Learning , 2021, IEEE Transactions on Intelligent Transportation Systems.

[11]  Ian F. Akyildiz,et al.  Designing Large-Scale Constellations for the Internet of Space Things With CubeSats , 2021, IEEE Internet of Things Journal.

[12]  Shunfan He,et al.  Joint UAV Position Optimization and Resource Scheduling in Space-Air-Ground Integrated Networks With Mixed Cloud-Edge Computing , 2020, IEEE Systems Journal.

[13]  Ying-Chang Liang,et al.  Joint Optimization of Handover Control and Power Allocation Based on Multi-Agent Deep Reinforcement Learning , 2020, IEEE Transactions on Vehicular Technology.

[14]  Beatriz Soret,et al.  Inter-Plane Inter-Satellite Connectivity in Dense LEO Constellations , 2020, IEEE Transactions on Wireless Communications.

[15]  Haipeng Yao,et al.  The Next Generation Heterogeneous Satellite Communication Networks: Integration of Resource Management and Deep Reinforcement Learning , 2020, IEEE Wireless Communications.

[16]  S. Chatzinotas,et al.  Satellite Communications in the New Space Era: A Survey and Future Challenges , 2020, IEEE Communications Surveys & Tutorials.

[17]  Yan Zhang,et al.  Physical-Layer Security in Space Information Networks: A Survey , 2020, IEEE Internet of Things Journal.

[18]  Wuyang Zhou,et al.  Energy-Efficient Collaborative Data Downloading by Using Inter-Satellite Offloading , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[19]  Mohamed-Slim Alouini,et al.  CubeSat Communications: Recent Advances and Future Challenges , 2019, IEEE Communications Surveys & Tutorials.

[20]  Ian F. Akyildiz,et al.  The Internet of Space Things/CubeSats , 2019, IEEE Network.

[21]  Zhu Han,et al.  Distributionally Robust Planning for Data Delivery in Distributed Satellite Cluster Network , 2019, IEEE Transactions on Wireless Communications.

[22]  Bo Hu,et al.  Learning for Matching Game in Cooperative D2D Communication With Incomplete Information , 2019, IEEE Transactions on Vehicular Technology.

[23]  Tianshu Chu,et al.  Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control , 2019, IEEE Transactions on Intelligent Transportation Systems.

[24]  Ibrahim Sanad,et al.  A Framework for Heterogeneous Satellite Constellation Design for Rapid Response Earth Observations , 2019, 2019 IEEE Aerospace Conference.

[25]  Zhu Han,et al.  Collaborative Data Scheduling With Joint Forward and Backward Induction in Small Satellite Networks , 2019, IEEE Transactions on Communications.

[26]  Nei Kato,et al.  A Cross-Domain SDN Architecture for Multi-Layered Space-Terrestrial Integrated Networks , 2019, IEEE Network.

[27]  Hongke Zhang,et al.  Modeling Space-Terrestrial Integrated Networks with Smart Collaborative Theory , 2019, IEEE Network.

[28]  Min Sheng,et al.  Performance Analysis of Intermittent Satellite Links With Time-Limited Queuing Model , 2018, IEEE Communications Letters.

[29]  Nei Kato,et al.  Space-Air-Ground Integrated Network: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[30]  Min Sheng,et al.  Channel-Aware Mission Scheduling in Broadband Data Relay Satellite Networks , 2018, IEEE Journal on Selected Areas in Communications.

[31]  Yueming Cai,et al.  Physical–Social-Aware D2D Content Sharing Networks: A Provider–Demander Matching Game , 2018, IEEE Transactions on Vehicular Technology.

[32]  Weihua Zhuang,et al.  Multi-Resource Coordinate Scheduling for Earth Observation in Space Information Networks , 2018, IEEE Journal on Selected Areas in Communications.

[33]  Nei Kato,et al.  Multi-Carrier Relaying for Successive Data Transfer in Earth Observation Satellite Constellations , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[34]  Alec Radford,et al.  Proximal Policy Optimization Algorithms , 2017, ArXiv.

[35]  Min Sheng,et al.  Toward a Flexible and Reconfigurable Broadband Satellite Network: Resource Management Architecture and Strategies , 2017, IEEE Wireless Communications.

[36]  Ning Li,et al.  A new satellite communication bandwidth allocation combined services model and network performance optimization , 2017, Int. J. Satell. Commun. Netw..

[37]  Min Sheng,et al.  Mission Aware Contact Plan Design in Resource-Limited Small Satellite Networks , 2017, IEEE Transactions on Communications.

[38]  Hejiao Huang,et al.  Collaborative Data Downloading by Using Inter-Satellite Links in LEO Satellite Networks , 2017, IEEE Transactions on Wireless Communications.

[39]  Miao Pan,et al.  Matching and Cheating in Device to Device Communications Underlying Cellular Networks , 2015, IEEE Journal on Selected Areas in Communications.

[40]  A. Roth,et al.  Two-sided matching , 1990 .

[41]  Cross‐Domain Resource Management Frameworks , 2022, Intelligent IoT for the Digital World.