Computer Science

Computer Science ›› 2022, Vol. 49 ›› Issue (2): 336-341.doi: 10.11896/jsjkx.201200126

• Computer Network • Previous Articles     Next Articles

Load Scheduling Algorithm for Distributed On-board RTs System Based on Machine Learning

TAN Shuang-jie1,2, LIN Bao-jun1,2,3,4,5, LIU Ying-chun2,3,4, ZHAO Shuai2,4   

  1. 1 School of Information Science and Technology,ShanghaiTech University,Shanghai 201210,China
    2 Innovation Academy for Microsatellites,Chinese Academy of Sciences,Shanghai 201203,China
    3 School of Computer Science and Technology,University of Chinese Academy of Sciences,Beijing 100094,China
    4 Shanghai Engineering Center for Microsatellites,Shanghai 201210,China
    5 Aerospace Information Research Institute,Chinese Academy of Sciences,Beijing 100094,China
  • Received:2020-12-14 Revised:2021-04-19 Online:2022-02-15 Published:2022-02-23
  • About author:TAN Shuang-jie,born in 1994,postgra-duate.Her main research interests include distributed computing and embedded software.
    LIN Bao-jun,born in 1963,Ph.D,professor,Ph.D supervisor.His main research interests include computer control technology and satellite overall.

PDF (PC)

632

Abstract: The tasks of distributed on-board multi-RTs (remote terminals) system are mainly distributed based on functions,while the burstiness of data processing tasks often leads to unbalanced load among different computers.Using a flexible load scheduling mechanism can effectively adjust the load difference between different computers,thereby improving the overall performance of the computer system to a certain extent.A load scheduling algorithm for distributed on-board RTs system based on machine learning is proposed in this paper,which includes four steps:sample collection,task throughput prediction model construction,throughput prediction and load scheduling.In the process of constructing the task throughput prediction model,the weight of the model is obtained through the linear regression normal equation of machine learning,which reduces the time spent in constructing the model.In the load scheduling link,if the total throughput rate of RTs is greater than the total load data volume of the system,data will be allocated to each RT in proportion to the throughput rate;otherwise,only a certain amount of data will be allocated to RTs whose load data volume is less than their own throughput rate.The test results on the ground simulation system constructed by multiple on-board computers electrical performance products show that the algorithm can increase the average CPU utilization rate of all nodes of the system by 23.78%,and reduce the variance of CPU utilization rate between nodes to 34.59%.The total system throughput of the task is significantly increased by 225.97%.In other words,this method can effectively improve system resource utilization while ensuring system load balance,and improve the real-time data processing performance of the on-board computer system.

Key words: Distributed system, Dynamic load balancing, Machine learning, On-board computer, Task scheduling

CLC Number: 

  • TP393
[1]SAEED N,ELZANATY A,ALMORAD H,et al.CubeSat Communications:Recent Advances and Future Challenges[J].IEEE Communication Survey & Tutorials,2020,22(3):1839-1862.
[2]LI H W,WU Q,XU G,et al.Progress and Tendency of Space and Earth Integrated Network[J].Science & Technology Review,2016,34(14):95-106.
[3]HUANG C.Reliable Reconstruction Technology for On-board Computer Based on Loongson and FLASH[D].Beijing:University of Chinese Academy of Sciences,2017.
[4]LU S Q,LIANG H G,LIU D Y.Thoughts on the Status Quo and Development of Localized On-board Computer Technology[J].Computer Knowledge and Technology,2018,6:126-129.
[5]PATNI J C,ASWAL M S.Distributed Load Balancing Modelfor Grid Computing Environment[C]//2015 1st International Conference on Next Generation Computing Technologies.2015:123-126.
[6]PENG T,HOFLINGER K,WEPS B,et al.A Component-Based Middleware for a Reliable Distributed and Reconfigurable Spacecraft Onboard Computer[C]//2016 IEEE 35th Symposium on Reliable Distributed Systems.2016:337-342.
[7]REN J Y,SUN H Y,ZHANG L X,et al.Development status ofspace laser communication and new method of networking[J].Laser & Infrared,2019,49(2):143-150.
[8]LIU L D,QI D Y.An Independent Task Scheduling Algorithmin Heterogeneous Multi-core Processor Environment[C]//2018 IEEE 3rd Advanced Information Technology,Electronic and Automation Control Conference.2018:142-146.
[9]ZHANG J,SUN S J,FAN H B,et al.Task Scheduling Algorithm in Heterogeneous Multi-core Processor with High Real-time Performance[J].Computer Engineering,2017,43(5):55-59.
[10]AN X,ZHANG Y,KANG A,et al.Machine learning based online mapping approach for heterogeneous multi-core processor system[J].Journal of Computer Applications,2019,39(6):1753-1759.
[11]IBM Cloud Education.Machine Learning Focuses on Applica-tions that Learn from Experience and Improve their Decision-making or Predictive Accuracy over Time[EB/OL].(2020-07-15)[2020-10-01].https://www.ibm.com/cloud/learn/machine-learning.
[12]SAMIE F,BAUER L,HENKEL J.From Cloud Down toThings:An Overview of Machine Learning in Internet of Things[J].IEEE Internet of Things Journal,2019,6(3):4921-4934.
[13]NEMIROVSKY D,ARKOSE T,MARKOVIC N,et al.A ma-chine learning approach for performance prediction and scheduling on heterogeneous CPUs[C]//Proceedings of the 2017 IEEE 29th International Symposium on Computer Architecture and High Performance Computing.Piscataway,NJ:IEEE,2017:121-128.
[14]MICOLET P J,SMITH A,DUBACH C.A machine learning approach to mapping streaming workloads to dynamic multicore processors[C]//LCTES 2016:Proceedings of the 2016 17th ACM SIGPLAN/SIGBED Conference on Languages,Compi-lers,Tools and Theory for Embedded Systems.New York:ACM,2016:113-122.
[15]ROTATION.Machine Learning－A Summary of Linear Regression[EB/OL].(2010-01-19)[2020-10-01].https://blog.csdn.net/fengxinlinux/article/details/86556584.
[16]XIE Y X,LI Y W,XIA Z J,et al.An Improved Forward Regression Variable Selection Algorithm for High-Dimensional Linear Regression Models[J].IEEE Access,2020,8:129032-129042.
[17]YUAN D M,PROUTIERE A,SHI G D.Distributed Online Li-near Regressions[J].Transactions on Information Theory,2021,67(1):616-639.
[18]YU D F,LI H J,TANG H,et al.Dynamic Load Balancing Algorithm Design and Application based on Feedback[J].Application Research of Computers,2012,29(2):527-529.
[19]GAST N,IOANNIDIS S,LOISEAU P,et al.Linear Regression from Strategic Data Sources[J].ACM Transactions on Econo-mics and Computation,2020,8(2):1-24.
[20]LIANG J B,ZHANG H H,JIANG C,et al.Research Progress of Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing[J].Computer Science,2021,48(7):316-323.
[1] LENG Dian-dian, DU Peng, CHEN Jian-ting, XIANG Yang. Automated Container Terminal Oriented Travel Time Estimation of AGV [J]. Computer Science, 2022, 49(9): 208-214.
[2] NING Han-yang, MA Miao, YANG Bo, LIU Shi-chang. Research Progress and Analysis on Intelligent Cryptology [J]. Computer Science, 2022, 49(9): 288-296.
[3] HE Qiang, YIN Zhen-yu, HUANG Min, WANG Xing-wei, WANG Yuan-tian, CUI Shuo, ZHAO Yong. Survey of Influence Analysis of Evolutionary Network Based on Big Data [J]. Computer Science, 2022, 49(8): 1-11.
[4] LI Yao, LI Tao, LI Qi-fan, LIANG Jia-rui, Ibegbu Nnamdi JULIAN, CHEN Jun-jie, GUO Hao. Construction and Multi-feature Fusion Classification Research Based on Multi-scale Sparse Brain Functional Hyper-network [J]. Computer Science, 2022, 49(8): 257-266.
[5] ZHANG Guang-hua, GAO Tian-jiao, CHEN Zhen-guo, YU Nai-wen. Study on Malware Classification Based on N-Gram Static Analysis Technology [J]. Computer Science, 2022, 49(8): 336-343.
[6] CHEN Ming-xin, ZHANG Jun-bo, LI Tian-rui. Survey on Attacks and Defenses in Federated Learning [J]. Computer Science, 2022, 49(7): 310-323.
[7] LI Ya-ru, ZHANG Yu-lai, WANG Jia-chen. Survey on Bayesian Optimization Methods for Hyper-parameter Tuning [J]. Computer Science, 2022, 49(6A): 86-92.
[8] ZHAO Lu, YUAN Li-ming, HAO Kun. Review of Multi-instance Learning Algorithms [J]. Computer Science, 2022, 49(6A): 93-99.
[9] WANG Fei, HUANG Tao, YANG Ye. Study on Machine Learning Algorithms for Life Prediction of IGBT Devices Based on Stacking Multi-model Fusion [J]. Computer Science, 2022, 49(6A): 784-789.
[10] XIAO Zhi-hong, HAN Ye-tong, ZOU Yong-pan. Study on Activity Recognition Based on Multi-source Data and Logical Reasoning [J]. Computer Science, 2022, 49(6A): 397-406.
[11] YAO Ye, ZHU Yi-an, QIAN Liang, JIA Yao, ZHANG Li-xiang, LIU Rui-liang. Android Malware Detection Method Based on Heterogeneous Model Fusion [J]. Computer Science, 2022, 49(6A): 508-515.
[12] XU Jie, ZHU Yu-kun, XING Chun-xiao. Application of Machine Learning in Financial Asset Pricing:A Review [J]. Computer Science, 2022, 49(6): 276-286.
[13] LI Ye, CHEN Song-can. Physics-informed Neural Networks:Recent Advances and Prospects [J]. Computer Science, 2022, 49(4): 254-262.
[14] FENG Liao-liao, DING Yan, LIU Kun-lin, MA Ke-lin, CHANG Jun-sheng. Research Advance on BFT Consensus Algorithms [J]. Computer Science, 2022, 49(4): 329-339.
[15] YAO Xiao-ming, DING Shi-chang, ZHAO Tao, HUANG Hong, LUO Jar-der, FU Xiao-ming. Big Data-driven Based Socioeconomic Status Analysis:A Survey [J]. Computer Science, 2022, 49(4): 80-87.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.