Computer Science ›› 2025, Vol. 52 ›› Issue (6): 316-323.doi: 10.11896/jsjkx.240300019

• Artificial Intelligence • Previous Articles     Next Articles

Efficient Remote Sensing Common Product Production Algorithm Based on Product Reuse Model

ZUO Xianyu, ZHOU Xiaohu, ZHOU Liming, XIE Yi, LIU Cheng   

  1. Henan Key Laboratory of Big Data Analysis and Processing,Henan University,Kaifeng,Henan 475000,China
    School of Computer and Information Engineering,Henan University,Kaifeng,Henan 475000,China
  • Received:2024-03-03 Revised:2024-08-17 Online:2025-06-15 Published:2025-06-11
  • About author:ZUO Xianyu,born in 1979,Ph.D,professor,Ph.D supervisor,is a member of CCF(No.G4801M).His main research interests include parallel computing and remote sensing big data processing.
    LIU Cheng,born in 1989,Ph.D,lectu-rer,is a member of CCF(No.l7262M).His main research interests include pattern recognition and image segmentation.
  • Supported by:
    National Key Research and Development Program for International Cooperation(2019YFE0126600),Henan Province Major Science and Technology Project(201400210300),Henan University Science and Technology Innovation Team(24IRTSTHN021),Henan Provincial Department of Science and Technology Research Project(232102210009),Henan Province Science and Technology Research(242102240021) and Postgraduate Education Reform and Quality Improvement Project of Henan Province(YJS2024JD30).

Abstract: With the increasing demand for remote sensing common products in various industries,the application of high-perfor-mance remote sensing product production system is increasing.As a key component of the system,excellent task scheduling algorithm can significantly improve its production efficiency.However,there are unique challenges in the production process of remote sensing generic products.If a large number of workflows are submitted for production in a short time,there are problems of dou-ble calculation and data processing in the processing of these workflows,and the amount of data required to generate generic pro-ducts is often large,and the process processing time is long,which easily leads to resource waste and production efficiency decline.In order to solve this problem,this paper proposes a task division strategy based on product reuse model,which focuses on optimizing workflow processing.Firstly,workflow submitted by users is packaged into a process package according to task repetition,and processes with repetitive tasks are assigned to the same computing node to reduce the data transmission time between nodes.Then,a product reuse model is introduced to allow different processing processes to reuse the obtained product results,reduce repetitive calculation and data processing,so as to improve production efficiency and meet the high efficiency needs of common product production.In order to verify the effectiveness of the proposed algorithm,the proposed algorithm and other traditional algorithms FCFS and SJF are simulated in the CloudSim simulation simulator respectively.The results show that the proposed scheduling algorithm has significantly lower total task completion time and average task response time than the other two algorithms,showing better performance.

Key words: High performance computing, Generic Remote sensing products, Product reuse, Task divison strategy, CloudSim

CLC Number: 

  • TP302
[1]CHI M,PLAZA A,BENEDIKTSSON J A,et al.Big data for remote sensing:Challenges and opportunities[C]//Proceedings of the IEEE.2016:2207-2219.
[2]TONG X D.China's high resolution earth observation systemconstruction of major projects progress [J].Journal of Remote Sensing,2016,29(6):927-933.
[3]ZHOU B,LI J G,WU G F,et al.A Visual Dataflow Model for Production of Remote Sensing Products[J].Journal of Henan University(Natural Science Edition),2013,43(1):74-78.
[4]FAN Y,LI B,FAVORITE D,et al.Dras:Deep reinforcementlearning for cluster scheduling in high performance computing[J].IEEE Transactions on Parallel and Distributed Systems,2022,33(12):4903-4917.
[5]WANG X,LI N,GONG G,et al.Load-balancing scheduling of simulation tasks based on a static-dynamic hybrid algorithm[J].Journal of Simulation,2022,16(2):182-193.
[6]HOFRI M.Disk scheduling:FCFS vs.SSTF revisited[J].Communications of the ACM,1980,23(11):645-653.
[7]ALWORAFI M A,DHARI A,AL-HASHMI A A,et al.An improved SJF scheduling algorithm in cloud computing environment[C]//2016 International Conference on Electrical,Electronics,Communication,Computer and Optimization Techniques(ICEECCOT).IEEE,2016:208-212.
[8]QIU X C,ZANG L,YANG D,et al.Multilevel feedback queue Scheduling Algorithm based on Process execution time [J].Science Technology and Engineering,2015,15(1):78-83.
[9]ANDERSSON B,BARUAH S,JONSSON J.Static-priorityscheduling on multiprocessors[C]//Proceedings 22nd IEEE Real-Time Systems Symposium(RTSS 2001).IEEE,2001:193-202.
[10]MIREGURI K,GU Y J.Simulation of LoadBalancing Time Slice Rotation Algorithms in Embedded Operating System[J].Computer Simulation,2019,36(11):247-250.
[11]SHI Y L,SHEN W M,XIONG W C et al.Research on job schedule and managementsystem for remote sensing data processing with cluster[J].Computer Engineering and Applications,2012,48(25):77-82.
[12]WU H H.Research and application of task scheduling model in massive remote sensing image common product generation [D].Zhengzhou:Henan University,2023.
[13]ZHENG F B,ZHANG Z,YU T,et al.Architecture of Remote Sensing Producing Line for Supporting[J].Computer Science,2012,39(S3):181-184,190.
[14]RAJAVEL R,MALA T.Achieving service level agreement in cloud environment using job prioritization in hierarchical sche-duling[C]//Proceedings of the International Conference on Information Systems Design and Intelligent Applications 2012(INDIA 2012) held in Visakhapatnam,India,January 2012.Springer Berlin Heidelberg,2012:547-554.
[15]QIU Y,JIANG C,WANG Y,et al.Energy aware virtual machine scheduling in data centers[J].Energies,2019,12(4):646.
[16]LIU Q H,WEN J G,ZHOU X,et al.High resolution remote sensing common product generation and authenticity test technology system[J].Journal of Remote Sensing,2023,27(3):544-562.
[17]ZHAO J P,CHEN D H,LI H,et al.A Dynamic IntegrationFramework of GIS System for Remote Sensing Algorithms[J].Computer Measurement and Control,2018,26(7):186-189,194.
[18]TSUR D.Faster deterministic algorithms for Co-path Packing and Co-path/cycle Packing[J].Journal of Combinatorial Optimization,2022,44(5):3701-3710.
[19]HEILIG L,RAJKUMAR B,STEFAN V.Location-aware bro-kering for consumers in multi-cloud computing environments[J].Journal of Network and Computer Applications,2017,95(10):79-93.
[20]LIU P.Cloud Computing.2nd Edition [M].Publishing House of Electronics Industry,2011.
[1] LIAO Zeming, LIU Guikai, HU Yonghua, XIE Anxing. Research on Efficient Code Generation Techniques for Array Computation for Vector DSPs [J]. Computer Science, 2025, 52(6A): 240300156-7.
[2] TAN Zhengyuan, ZHONG Jiaqing, CHEN Juan. AI+HPC:An Overview of Supercomputing System Software and Application Technology Development Driven by “AI+” [J]. Computer Science, 2025, 52(5): 1-10.
[3] LIAO Qiucheng, ZHOU Yang, LIN Xinhua. Metrics and Tools for Evaluating the Deviation in Parallel Timing [J]. Computer Science, 2025, 52(5): 41-49.
[4] CHEN Yiyang, WANG Xiaoning, YAN Xiaoting, LI Guanlong ZHAO Yining, LU Shasha, XIAO Haili. Study on High Performance Computing Container Checkpoint Technology Based on CRIU [J]. Computer Science, 2024, 51(9): 40-50.
[5] YAN Xiaoting, WANG Xiaoning, DONG Sheng, ZHAO Yining, XIAO Haili. Review on the Development and Application of Checkpointing Technology in High-performanceComputing [J]. Computer Science, 2024, 51(9): 1-14.
[6] CHEN Yiyang, WANG Xiaoning, LU Shasha, XIAO Haili. Survey of Container Technology for High-performance Computing System [J]. Computer Science, 2023, 50(2): 353-363.
[7] CHEN Guo-liang, ZHANG Yu-jie, . Development of Parallel Computing Subject [J]. Computer Science, 2020, 47(8): 1-4.
[8] WANG Yang, LI Peng, JI Yi-mu, FAN Wei-bei, ZHANG Yu-jie, WANG Ru-chuan, CHEN Guo-liang. High Performance Computing and Astronomical Data:A Survey [J]. Computer Science, 2020, 47(1): 1-6.
[9] YAN Hui, ZHU Bo-jing, WAN Wen, ZHONG Yin, David A YUNE. HPIC-LBM Method Based Simulation of Large Temporal-Spatial Scale 3D Turbulent Magnetic Reconnection on Supercomputer [J]. Computer Science, 2019, 46(8): 89-94.
[10] JIA Xun, QIAN Lei, WU Gui-ming, WU Dong, XIE Xiang-hui. Research Advances and Future Challenges of FPGA-based High Performance Computing [J]. Computer Science, 2019, 46(11): 11-19.
[11] YUAN Jia-xin, CHEN Jian-xin, XIAO Jun, WU Dao-liang. Time-aware Minimum Area Task Scheduling Algorithm Based on Backfilling Algorithm [J]. Computer Science, 2018, 45(8): 100-104.
[12] SI Yu-meng, WEI Jian-wen, Simon SEE and James LIN. Parallel Design and Optimization of Galaxy Group Finding Algorithm on Comparation of SGI and Distributed-memory Cluster [J]. Computer Science, 2017, 44(10): 80-84.
[13] WANG Yi-chao, QIN Qiang, SEE Simon and LIN Xin-hua. Performance Portability Evaluation for OpenACC on Intel Knights Corner and NVIDIA Kepler [J]. Computer Science, 2015, 42(1): 75-78.
[14] LI Jing-mei,WANG Xue and WU Yan-xia. Improved Priority List Task Scheduling Algorithm [J]. Computer Science, 2014, 41(5): 20-23.
[15] WANG Wen-yi,WANG Chun-xia and WANG Jie. Research on Hybrid Parallel Programming Technique Based on CMP Multi-cure Cluster [J]. Computer Science, 2014, 41(2): 19-22.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!