Computer Science ›› 2026, Vol. 53 ›› Issue (2): 406-415.doi: 10.11896/jsjkx.250200092

• Computer Netword • Previous Articles     Next Articles

Deep Reinforcement Learning-based Aircraft Task Offloading in Low Earth Orbit Satellite Networks

LI Fang, YUAN Baochun, SHEN Hang, WANG Tianjing, BAI Guangwei   

  1. College of Computer and Information Engineering(College of Artificial Intelligence),Nanjing Tech University,Nanjing 211816,China
  • Received:2025-02-24 Revised:2025-05-19 Published:2026-02-10
  • About author:LI Fang,born in 1999,postgraduate.Her main research interest is intelligent network computing.
    SHEN Hang,born in 1984,Ph.D,asso-ciate professor,master’s supervisor,is a senior member of CCF(No.19088S).His main research interest is space-air-ground integrated networks.
  • Supported by:
    National Natural Science Foundation of China(61502230,61501224),Natural Science Foundation of Jiangsu Province,China(BK20201357),Six Talent Peaks Project in Jiangsu Province(RJFW-020) and Postgraduate Research & Practice Innovation Program of Jiangsu Province(SJCX24_0566).

Abstract: LEO satellite communication has the advantages of long transmission distance,wide coverage,and is not restricted by terrain.It has become an important communication method for the civil aviation transportation and general aviation industries.However,the low-orbit satellite network is a highly heterogeneous and dynamic environment.The mobility of satellite nodes,the complexity of communication links,uneven spatial and temporal distribution of aircraft,and the coexistence of multiple services make task offloading and resource allocation face many challenges.To this end,this paper proposes an aircraft task offloading method based on DDRL,with the purpose of maximizing the overall effectiveness of the system.Firstly,the system utility maximization problem is modeled as a joint optimization problem of task offloading and resource allocation,taking into account the computing power and coverage time of LEO satellites.Next,the problem is transformed into a Markov decision process,using DDQN algorithm to learn the optimal task offloading decision,and based on this,TD3 is used to obtain the optimal resource allocation strategy.Simulation experiments show that under different computing resources and communication resources,the proposed scheme is better than other benchmark schemes in terms of system utility,proving the usability of the proposed framework.

Key words: LEO satellite network, Task offloading, Resource allocation, Deep reinforcement learning

CLC Number: 

  • TP393
[1]MAO Y,YOU C,ZHANG J,et al.A survey on mobile edge computing:The communication perspective[J].IEEE communications surveys & tutorials,2017,19(4):2322-2358.
[2]DENBY B,LUCIA B.Orbital edge computing:Machine infe-rence in space[J].IEEE Computer Architecture Letters,2019,18(1):59-62.
[3]WEI J,HAN J,CAO S.Satellite IoT edge intelligent computing:A research on architecture[J].Electronics,2019,8(11):1247.
[4]CAO S,ZHAO Y,WEI J,et al.Space-based cloud-fog computing architecture and its applications[C]//2019 IEEE World Congress on Services(SERVICES).IEEE,2019:166-171.
[5]GUO J,DU Y.Fog service in space information network:Architecture,use case,security and challenges[J].IEEE Access,2020,8:11104-11115.
[6]WEI J,CAO S.Application of edge intelligent computing in sa-tellite Internet of Things[C]//2019 IEEE International Confe-rence on Smart Internet of Things(SmartIoT).IEEE,2019:85-91.
[7]WANG Y,YANG J,GUO X,et al.Satellite edge computing for the internet of things in aerospace[J].Sensors,2019,19(20):4375.
[8]XIE R,TANG Q,WANG Q,et al.Satellite-terrestrial integrated edge computing networks:Architecture,challenges,and open issues[J].IEEE Network,2020,34(3):224-231.
[9]LI C,ZHANG Y,HAO X,et al.Jointly optimized request dispatching and service placement for MEC in LEO network[J].China Communications,2020,17(8):199-208.
[10]CAO B,ZHANG J,LIU X,et al.Edge-cloud resource scheduling in space-air-ground-integrated networks for internet of vehicles[J].IEEE Internet of Things Journal,2021,9(8):5765-5772.
[11]CUI G,LONG Y,XU L,et al.Joint offloading and resource allocation for satellite assisted vehicle-to-vehicle communication[J].IEEE Systems Journal,2020,15(3):3958-3969.
[12]WANG B,FENG T,HUANG D.A joint computation offloading and resource allocation strategy for LEO satellite edge computing system[C]//2020 IEEE 20th International Conference on Communication Technology(ICCT).IEEE,2020:649-655.
[13]CUI G,LI X,XU L,et al.Latency and energy optimization for MEC enhanced SAT-IoT networks[J].IEEE Access,2020,8:55915-55926.
[14]TRAN T X,POMPILI D.Joint task offloading and resource allocation for multi-server mobile-edge computing networks[J].IEEE Transactions on Vehicular Technology,2018,68(1):856-868.
[15]LI N,YUE C F,GUO H B,et al.Design of large scale satellite cluster domain control strategy[J].Chinese Space Science and Technology,2023,43(1):18-28.
[16]CASONI M,GRAZIA C A,KLAPEZ M,et al.Integration of satellite and LTE for disaster recovery[J].IEEE Communications Magazine,2015,53(3):47-53.
[17]WANG F,JIANG D,QI S,et al.Fine-grained resource management for edge computing satellite networks[C]//2019 IEEE Global Communications Conference(GLOBECOM).IEEE,2019:1-6.
[18]SU Y,LIU Y,ZHOU Y,et al.Broadband LEO satellite communications:Architectures and key technologies[J].IEEE Wireless Communications,2019,26(2):55-61.
[19]TANG Q,FEI Z,LI B,et al.Computation offloading in LEOsatellite networks with hybrid cloud and edge computing[J].IEEE Internet of Things Journal,2021,8(11):9169176.
[20]CUI G,LONG Y,XU L,et al.Joint offloading and resource allocation for satellite assisted vehicle-to-vehicle communication[J].IEEE Systems Journal,2020,15(3):3958-3969.
[21]DE SANCTIS M,CIANCA E,ARANITI G,et al.Satellite communications supporting internet of remote things[J].IEEE Internet of Things Journal,2015,3(1):113-123.
[22]CAO X,YANG B,SHEN Y,et al.Edge-assisted multi-layer offloading optimization of LEO satellite-terrestrial integrated networks[J].IEEE Journal on Selected Areas in Communications,2022,41(2):381-398.
[23]SONI G,SHARMA M.Performance Evaluation of a Free Space Optical Link-Based Inter Satellite Link(ISL) across Low Earth Orbit(LEO)[C]//2022 2nd International Conference on Power Electronics & IoT Applications in Renewable Energy and Its Control(PARC).IEEE,2022:1-5.
[24]ZHANG H,LIU R,KAUSHIK A,et al.Satellite edge computing with collaborative computation offloading:An intelligent deep deterministic policy gradient approach[J].IEEE Internet of Things Journal,2023,10(10):9092-9107.
[25]GAO X,LIU R,KAUSHIK A.Virtual network function placement in satellite edge computing with a potential game approach[J].IEEE Transactions on Network and Service Management,2022,19(2):1243-1259.
[26]GAO X,LIU R,KAUSHIK A,et al.Dynamic resource allocation for virtual network function placement in satellite edge clouds[J].IEEE Transactions on Network Science and Engineering,2022,9(4):2252-2265.
[27]LI Q,WANG S,MA X,et al.Service coverage for satellite edge computing[J].IEEE Internet of Things Journal,2021,9(1):695-705.
[28]CAO X,YANG B,SHEN Y,et al.Edge-assisted multi-layer offloading optimization of LEO satellite-terrestrial integrated networks[J].IEEE Journal on Selected Areas in Communications,2022,41(2):381-398.
[29]WU Y C,DINH T Q,FU Y,et al.A hybrid DQN and optimization approach for strategy and resource allocation in MEC networks[J].IEEE Transactions on Wireless Communications,2021,20(7):4282-4295.
[1] HUAN Haisheng, ZHAO Peng, CHEN Nuo, KA Zuming. Review of Offloading Technologies Research in Mobile Edge Computing [J]. Computer Science, 2026, 53(2): 367-378.
[2] WEI Manyi, WANG Gaocai, WEN Yihu. Game Theory-based Optimization of Flight Paths and Task Offloading in UAV-assisted MECSystems [J]. Computer Science, 2026, 53(2): 396-405.
[3] ZHANG Wanyou, SONG Lipeng. Cloud Email Defense Resource Allocation Method Based on User Behavior [J]. Computer Science, 2026, 53(2): 442-453.
[4] WANG Haoyan, LI Chongshou, LI Tianrui. Reinforcement Learning Method for Solving Flexible Job Shop Scheduling Problem Based onDouble Layer Attention Network [J]. Computer Science, 2026, 53(1): 231-240.
[5] CHEN Jintao, LIN Bing, LIN Song, CHEN Jing, CHEN Xing. Dynamic Pricing and Energy Scheduling Strategy for Photovoltaic Storage Charging Stations Based on Multi-agent Deep Reinforcement Learning [J]. Computer Science, 2025, 52(9): 337-345.
[6] ZHANG Yongliang, LI Ziwen, XU Jiahao, JIANG Yuchen, CUI Ying. Congestion-aware and Cached Communication for Multi-agent Pathfinding [J]. Computer Science, 2025, 52(8): 317-325.
[7] FAN Xinggang, JIANG Xinyang, GU Wenting, XU Juntao, YANG Youdong, LI Qiang. Effective Task Offloading Strategy Based on Heterogeneous Nodes [J]. Computer Science, 2025, 52(8): 354-362.
[8] HUO Dan, YU Fuping, SHEN Di, HAN Xueyan. Research on Multi-machine Conflict Resolution Based on Deep Reinforcement Learning [J]. Computer Science, 2025, 52(7): 271-278.
[9] WANG Xiang, HAN Qinghai, LIANG Jiarui, YU Xiaoli, WU Qi, QING Li. Research on Multi-user Task Offloading and Service Caching Strategies [J]. Computer Science, 2025, 52(7): 307-314.
[10] WU Zongming, CAO Jijun, TANG Qiang. Online Parallel SDN Routing Optimization Algorithm Based on Deep Reinforcement Learning [J]. Computer Science, 2025, 52(6A): 240900018-9.
[11] ZHAO Chanchan, YANG Xingchen, SHI Bao, LYU Fei, LIU Libin. Optimization Strategy of Task Offloading Based on Meta Reinforcement Learning [J]. Computer Science, 2025, 52(6A): 240800050-8.
[12] WANG Chenyuan, ZHANG Yanmei, YUAN Guan. Class Integration Test Order Generation Approach Fused with Deep Reinforcement Learning andGraph Convolutional Neural Network [J]. Computer Science, 2025, 52(6): 58-65.
[13] ZHAO Xuejian, YE Hao, LI Hao, SUN Zhixin. Multi-AGV Path Planning Algorithm Based on Improved DDPG [J]. Computer Science, 2025, 52(6): 306-315.
[14] ZHANG Minghao, XIAO Bohuai, ZHENG Song, CHEN Xing. Resource Allocation Method with Workload-time Windows for Serverless Applications inCloud-edge Collaborative Environment [J]. Computer Science, 2025, 52(6): 336-345.
[15] LI Yuanbo, HU Hongchao, YANG Xiaohan, GUO Wei, LIU Wenyan. Intrusion Tolerance Scheduling Algorithm for Microservice Workflow Based on Deep Reinforcement Learning [J]. Computer Science, 2025, 52(5): 375-383.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!