Computer Science

Computer Science ›› 2022, Vol. 49 ›› Issue (11): 250-258.doi: 10.11896/jsjkx.211200234

• Computer Network • Previous Articles     Next Articles

Survey of Multi-cloud Workflow Scheduling

YU Hao-wen1, LIU Bo1, ZHOU Na-qin2, LIN Wei-wei3, LIU Peng1   

  1. 1 School of Computer Science,South China Normal University,Guangzhou 510631,China
    2 School of Computer Science and Network Engineering,Guangzhou University,Guangzhou 510006,China
    3 School of Computer Science and Engineering,South China University of Technology,Guangzhou 510006,China
  • Received:2021-12-21 Revised:2022-05-20 Online:2022-11-15 Published:2022-11-03
  • About author:YU Hao-wen,born in 1997,postgra-duate.Her main research interests include cloud computing and resource scheduling.
    LIU Bo,born in 1968,Ph.D,professor,is a member of China Computer Federation.His main research interests include cloud computing,big data technology and distributed security technology.
  • Supported by:
    Key Research and Development Program of Guangdong Province(2021B0101420002,20200704002),General Project of National Natural Science Foundation of China(62002078,61872084),Basic and Applied Basic Research Foundation of Guangdong Province(2019B030302002) and Guangzhou Development Zone International Cooperation Project(2020GH10,2021GH10).

PDF (PC)

412

Abstract: Traditional cloud providers provide services solely for users,which has problems of insufficient local cloud resources and high expansion costs.While the emerging multi-cloud combines services of cloud providers with different geographical locations providing users with more choices and has gradually become a research hotspot.At the same time,workflow scheduling is one of the key problems in multi-cloud research.Therefore,this paper firstly makes a thorough investigation and analysis on workflow scheduling technology in multi-cloud environment,then compares and classifies the workflow scheduling method inclu-ded.This paper focuses on single objective workflow scheduling optimization problem for cost and completion time,multi-objective optimization workflow scheduling problem for cost and completion time,for response time and cost,for reliability,cost and completion time,and for other multi-objective optimization.Finally,the future research directions of workflow scheduling in the multi-cloud environment are discussed,including uncertain workflow scheduling,joint scheduling optimization of energy consumption and other objectives,scheduling optimization with edge servers,and hybrid scheduling of virtual machine and Serverless platform.

Key words: Multi-cloud, Workflow, Scheduling of resources

CLC Number: 

  • TP393
[1]LEE K.Comments on Secure Data Sharing in Cloud Computing Using Revocable-Storage Identity-Based Encryption[J].IEEE Transactions on Cloud Computing,2020,8(4):1299-1300.
[2]CUI J,ZHANG X,ZHONG H,et al.Extensible conditional privacy protection authentication scheme for secure vehicular networks in a multi-cloud environment [J/OL].IEEE Transactions on Information Forensics and Security,2019,15:1654-1667.https://ieeexplore.ieee.org/abstract/document/8865553.
[3]ZHANG B,ZENG Z,SHI X,et al.A novel cooperative resource provisioning strategy for Multi-Cloud load balancing [J/OL].Journal of Parallel and Distributed Computing,2021,152:98-107.https://www.sciencedirect.com/science/article/abs/pii/S0743731521000241.
[4]Multicloud.[EB/OL].(2021-08-09).[2021-11-08].https://www.ibm.com/cloud/learn/multicloud.
[5]HEILIG L,LALLA-RUIZ E,VO S.Modeling and solvingcloud service purchasing in multi-cloud environments [J/OL].Expert Systems with Applications,2020,147:113165.https://www.sciencedirect.com/science/article/abs/pii/S0957417419308826.
[6]GHAHRAMANI M H,ZHOU M C,HON C T.Toward cloud computing QoS architecture:Analysis of cloud systems and cloud services[J].IEEE/CAA Journal of Automatica Sinica,2017,4(1):6-18.
[7]KANG S,VEERAVALLI B,AUNG K M M.Dynamic scheduling strategy with efficient node availability prediction for handling divisible loads in multi-cloud systems [J/OL].Journal of Parallel and Distributed Computing,2018,113:1-16.https://www.sciencedirect.com/science/article/abs/pii/S0743731517302824.
[8]Global Cloud Computing Market Size & Share Will Reach USD 1025.9 Billion by 2026:Facts &Factors[EB/OL].(2021-01-22)[2021-02-28].https://www.globenewswire.com/news.
[9]IRANMANESH A,NAJI H R.DCHG-TS:a deadline-constrai-ned and cost-effective hybrid genetic algorithm for scientific workflow scheduling in cloud computing [J].Cluster Computing,2021,24(2):667-681.
[10]TOMARCHIO O,CALCATERRA D,DI MODICA G.Cloud resource orchestration in the multi-cloud landscape:a systematic review of existing frameworks [J].Journal of Cloud Computing,2020,9(1):1-24.
[11]HOSSEINZADEH M,GHAFOUR M Y,HAMA H K,et al.Multi-objective task and workflow scheduling approaches in cloud computing:a comprehensive review [J/OL].Journal of Grid Computing,2020:1-30.https://link.springer.com/article/10.1007/s10723-020-09533-z.
[12]ARUNARANI A R,MANJULA D,SUGUMARAN V.Taskscheduling techniques in cloud computing:A literature survey [J/OL].Future Generation Computer Systems,2019,91:407-415.https://www.sciencedirect.com/science/article/abs/pii/S0167739X17321519.
[13]KUMAR M,SHARMA S C,GOEL A,et al.A comprehensive survey for scheduling techniques in cloud computing [J/OL].Journal of Network and Computer Applications,2019,143:1-33.https://www.sciencedirect.com/science/article/abs/pii/S1084804519302036.
[14]MASDARI M,ZANGAKANI M.Efficient task and workflow scheduling in inter-cloud environments:challenges and opportunities [J].The Journal of Supercomputing,2020,76(1):499-535.
[15]ALALUNA M,VIAL E,NEVES N,et al.Secure multi-cloud network virtualization [J/OL].Computer Networks,2019,161:45-60.https://www.sciencedirect.com/science/article/abs/pii/S1389128618312155.
[16]WANG G,NG T S E.The impact of virtualization on network performance of amazon ec2 data center[C]//2010 Proceedings IEEE INFOCOM.IEEE,San Diego,CA,USA,2010:1-9.
[17]REDKAR T,GUIDICI T,MEISTER T.Windows azure plat-form[M].New York:Apress,2009.
[18]ZHU Q H,TANG H,HUANG J J,et al.Task Scheduling for Multi-Cloud Computing Subject to Security and Reliability Constraints [J].IEEE/CAA Journal of Automatica Sinica,2021,8(4):848-865.
[19]LIU J,REN J,DAI W,et al.Online Multi-Workflow Scheduling under Uncertain Task Execution Time in IaaS Clouds [J/OL].IEEE Transactions on Cloud Computing,2019:1-1.https://ieeexplore.ieee.org/abstract/document/8669862.
[20]CHEN W,XIE G,LI R,et al.Efficient task scheduling for bu-dget constrained parallel applications on heterogeneous cloud computing systems [J/OL].Future Generation Computer Systems,2017,74:1-11.https://www.sciencedirect.com/science/article/abs/pii/S0167739X16304411.
[21]CAO B,ZHAO J,GU Y,et al.Security-Aware Industrial Wireless Sensor Network Deployment Optimization[J].IEEE Transa-ctions on Industrial Informatics,2020,16(8):5309-5316.
[22]ROSA M J F,RALHA C G,HOLANDA M,et al.Computatio-nal resource and cost prediction service for scientific workflows in federated clouds[J/OL].Future Generation Computer Systems,2021,125:844-858.https://www.sciencedirect.com/science/article/abs/pii/S0167739X21002922.
[23]PAKNEJAD P,KHORSAND R,RAMEZANPOUR M.Chaotic improved PICEA-g-based multi-objective optimization for workflow scheduling in cloud environment [J/OL].Future Generation Computer Systems,2021,117:12-28.https://www.scien-cedirect.com/science/article/abs/pii/S0167739X20330260.
[24]FAKHFAKH F,KACEM H H,KACEM A H.Workflowscheduling in cloud computing:a survey[C]//2014 IEEE 18th International Enterprise Distributed Object ComputingConfe-rence Workshops and Demonstrations.IEEE,Ulm,Germany,2014:372-378.
[25]MING T,OTA K,DONG M X.DSARP:dependable scheduling with active replica placement for workflow applications in cloud computing [J/OL].IEEE Transactions on Cloud Computing,2016:1069-1078.https://ieeexplore.ieee.org/abstract/document/7742980.
[26]MOHAMMADI S,POURKARIMI L,PEDRAM H.Integer li-near programming-based multi-objective scheduling for scientific workflows in multi-cloud environments[J].The Journal of Supercomputing,2019,75(10):6683-6709.
[27]ZHOU J L,WANG T,CONG P J,et al.Cost and makespan-aware workflow scheduling in hybrid clouds [J/OL].Journal of Systems Architecture,2019,100:101631.https://www.scien-cedirect.com/science/article/pii/S1383762119302954.
[28]BUGINGO E,ZHANG D,CHEN Z,et al.Towards decomposition based multi-objective workflow scheduling for big data processing in clouds [J].Cluster Computing,2021,24(1):115-139.
[29]GU Y,BUDATI C.Energy-aware workflow scheduling and optimization in clouds using bat algorithm [J/OL].Future Generation Computer Systems,2020,113:106-112.https://www.scien-cedirect.com/science/article/abs/pii/S0167739X19317066.
[30]ZHANG L,LI K,LI C,et al.Bi-objective workflow scheduling of the energy consumption and reliability in heterogeneous computing systems[J/OL].Information Sciences,2017,379:241-256.https://www.sciencedirect.com/science/article/abs/pii/S0020025516305722.
[31]JIANG F,FERRITER K,CASTILLO C.PIVOT:Cost-AwareScheduling of Data-Intensive Applications in a Cloud-Agnostic System [R/OL].Technical Report TR-19-02.RENCI,University of North Carolina at Chapel Hill.8 pages.https://renci.org/technical-reports/tr-19-02,2019.
[32]JIANG F,FERRITER K,CASTILLO C.A cloud-agnosticframework to enable cost-aware scheduling of applications in a multi-cloud environment[C]//2020 IEEE/IFIP Network Operations and Management Symposium(NOMS 2020).IEEE,Budapest,Hungary,2020:1-9.
[33]XU S J,LIU G G.A Novel Scheduling Algorithm for Scientific Workflow in Multi-cloud Environment[J].Journal of Minjiang University,2018,39(5):63-72.
[34]HEIDSIECK G,OLIVEIRA D D,PACITTI E,et al.Cache-aware scheduling of scientific workflows in a multisite cloud[J/OL].Future Generation Computer Systems,2021,122(7).https://www.sciencedirect.com/science/article/abs/pii/S0167739X21000923.
[35]LIU J,PACITTIE,VALDURIE Z P,et al.Multi-objectivescheduling of Scientific Workflows in multisite clouds [J].Future Generation Computer Systems,2016,63(oct.):76-95.
[36]SENTURK I F,BALAKRISHNAN P,ABU-DOLEH A,et al.A resource provisioning framework for bioinformatics applications in multi-cloud environments [J/OL].Future Generation Computer Systems,2018,78:379-391.https://www.sciencedirect.com/science/article/abs/pii/S0167739X16301911.
[37]ULABEDIN Z,NAZIR B.Replication and data management-based workflow scheduling algorithm for multi-cloud data centre platform [J/OL].The Journal of Supercomputing,2021:1-30.https://link.springer.com/article/10.1007/s11227-020-03541-2.
[38]TAO S, MA H,CHEN G.A genetic-based approach to location-aware cloud service brokering in multi-cloud environment[C]//2019 IEEE International Conference on Services Computing(SCC).IEEE,2019.
[39]MA H,DA SILVA A S,KUANG W.NSGA-II with local search for multi-objective application deployment in multi-cloud[C]//2019 IEEE Congress on Evolutionary Computation(CEC).IEEE,Wellington,New Zealand,2019:2800-2807.
[40]ZHANG Q.Knowledge Incorporation in Evolutionary Computation [Book Review][J].IEEE Computational Intelligence Magazine,2006,1(4):58-59.
[41]SHI T,MA H,CHEN G.Seeding-Based Multi-Objective Evolutionary Algorithms for Multi-Cloud Composite Applications Deployment[C]//2020 IEEE International Conference on Services Computing(SCC).IEEE,Beijing,China,2020:240-247.
[42]POOLA D,RAMAMOHANARAO K,BUYYA R.Enhancingreliability of workflow execution using task replication and spot instances [J].ACM Transactions on Autonomous and Adaptive Systems(TAAS),2016,10(4):1-21.
[43]SINGH A,CHATTERJEE K.Cloud security issues and challenges:A survey[J/OL].Journal of Network and Computer Applications,2017,79:88-115.https://www.sciencedirect.com/science/article/abs/pii/S1084804516302983.
[44]HU H,LI Z,HU H,et al.Multi-objective scheduling for scientific workflow in multicloud environment [J/OL].Journal of Network and Computer Applications,2018,114:108-122.https://www.sciencedirect.com/science/article/abs/pii/S1084804518301152.
[45]FARID M,LATIP R,HUSSIN M,et al.Scheduling ScientificWorkflow Using Multi-Objective Algorithm With Fuzzy Resource Utilization in Multi-Cloud Environment [J/OL].IEEE Access,2020.https://ieeexplore.ieee.org/abstract/document/8976136.
[46]MENDELJ M.Fuzzy logic systems for engineering:a tutorial[J].Proceedings of the IEEE,1995,83(3):345-377.
[47]TANG X.Reliability-Aware Cost-Efficient Scientific Workflows Scheduling Strategy on Multi-Cloud Systems [J/OL].IEEE Transactions on Cloud Computing,2021.https://ieeexplore.ieee.org/abstract/document/9349203.
[48]MISHRA S K,MISHRA S,ALSAYAT A,et al.Energy-aware task allocation for multi-cloud networks [J/OL].IEEE Access,2020,8:178825-178834.https://ieeexplore.ieee.org/abstract/document/9205994.
[49]BARIKA M,GARG S,CHAN A,et al.Scheduling algorithmsfor efficient execution of stream workflow applications in multicloud environments [J].IEEE Transactions on Services Computing,2022,15(2):860-875.
[50]CHEN Z,LIN K,LIN B,et al.Adaptive Resource Allocation and Consolidation for Scientific Workflow Scheduling in Multi-Cloud Environments [J/OL].IEEE Access,2020,8:190173-190183.https://ieeexplore.ieee.org/document/9233315.
[51]MANAM S,MOESSNER K,VURAL S.A Cost-Aware Strategy for Deadline Constrained Scientific Workflows[J].Journal of Physics:Conference Series,2020,1577(1):012036.
[52]SHI T,MA H,CHEN G,et al.Location-aware and budget-constrained service deployment for composite applications in multi-cloud environment [J].IEEE Transactions on Parallel and Distributed Systems,2020,31(8):1954-1969.
[53]WEN Z,GARG S,AUJLA G S,et al.Running Industrial Workflow Applications in a Software-Defined Multicloud Environment Using Green Energy Aware Scheduling Algorithm [J].IEEE Transactions on Industrial Informatics,2020,17(8):5645-5656.
[54]LI R,WU C Q,HOU A,et al.On scheduling of high-throughput scientific workflows under budget constraints in multi-cloud environments[C]//2018 IEEE International Conference on Parallel & Distributed Processing with Applications,Ubiquitous Computing & Communications,Big Data & Cloud Computing,Social Computing & Networking,Sustainable Computing & Communications(ISPA/IUCC/BDCloud/SocialCom/SustainCom).IEEE,Melbourne,VIC,Australia,2018:1087-1094.
[55]CALZAROSSA M C,DELLA VEDOVA M L,MASSARI L,et al.Multi-Objective Optimization of Deadline and Budget-Aware Workflow Scheduling in Uncertain Clouds [J/OL].IEEE Access,2021,9:89891-89905.https://ieeexplore.ieee.org/abstract/document/9461757.
[56]CHEN H,ZHU X,LIU G,et al.Uncertainty-Aware OnlineScheduling for Real-Time Workflows in Cloud Service Environment [J/OL].IEEE Transactions on Services Computing,2018.https://ieeexplore.ieee.org/abstract/document/8443134.
[57]ZHANG X D.Multi-objective optimization of workflow scheduling in uncertain cloud environment[J/OL].Computer Enginee-ring and Design,2021,42(7):9.https://www.cnki.com.cn/Article/CJFDTotal-SJSJ202107021.htm.
[58]XIE Y,ZHU Y,WANG Y,et al.A novel directional and non-local-convergent particle swarm optimization based workflow scheduling in cloud-edge environment[J/OL].Future Generation Computer Systems,2019,97:361-378.https://www.scien-cedirect.com/science/article/abs/pii/S0167739X18321332.
[59]XU X,CAO H,GENG Q,et al.Dynamic resource provisioning for workflow scheduling under uncertainty in edge computing environment [J/OL].Concurrency and Computation:Practice and Experience,2020.https://onlinelibrary.wiley.com/doi/abs/10.1002/cpe.5674.
[60]DAS A,LEAF A,VARELA C A,et al.Skedulix:Hybrid Cloud Scheduling for Cost-Efficient Execution of Serverless Applications[C]//2020 IEEE 13th International Conference on Cloud Computing(CLOUD).IEEE,Beijing,China,2020:609-618.
[61]BAARZI A F,KESIDIS G,JOE-WONG C,et al.On Merits and Viability of Multi-Cloud Serverless[C]//Proceedings of the ACM Symposium on Cloud Computing.Seattle,WA,USA,2021:600-608.
[62]MA Z H,LIU B,LIN W W,et al.A Survey of resource scheduling for serverless plantform[J].Computer Science,2021,48(4):261-267.
[1] LIU Peng, LIU Bo, ZHOU Na-qin, PENG Xin-yi, LIN Wei-wei. Survey of Hybrid Cloud Workflow Scheduling [J]. Computer Science, 2022, 49(5): 235-243.
[2] LIN Chao-wei, LIN Bing, CHEN Xing. Study on Scientific Workflow Scheduling Based on Fuzzy Theory Under Edge Environment [J]. Computer Science, 2022, 49(2): 312-320.
[3] DOU Shuai, LI Zi-yang, ZHU Jia-jia, LI Xiao-hui, LI Xue-song, MI Lin, YANG Guang, LI Chuan-rong. Design and Implementation of Scientific Experiment Management System Based on jBPM [J]. Computer Science, 2021, 48(6A): 658-663.
[4] HE Heng, JIANG Jun-jun, FENG Ke, LI Peng, XU Fang-fang. Efficient Multi-keyword Retrieval Scheme Based on Attribute Encryption in Multi-cloud Environment [J]. Computer Science, 2021, 48(11A): 576-584.
[5] LIU Zhang-hui, ZHAO Xu, LIN Bing, CHEN Xing. Data Placement Strategy of Scientific Workflow Based on Fuzzy Theory in Hybrid Cloud [J]. Computer Science, 2021, 48(11): 199-207.
[6] MA Yu-yin, ZHENG Wan-bo, MA Yong, LIU Hang, XIA Yun-ni, GUO Kun-yin, CHEN Peng, LIU Cheng-wu. Multi-workflow Offloading Method Based on Deep Reinforcement Learning and ProbabilisticPerformance-awarein Edge Computing Environment [J]. Computer Science, 2021, 48(1): 40-48.
[7] ZHANG Long-xin, ZHOU Li-qian, WEN Hong, XIAO Man-sheng, DENG Xiao-jun. Energy Efficient Scheduling Algorithm of Workflows with Cost Constraint in Heterogeneous Cloud Computing Systems [J]. Computer Science, 2020, 47(8): 112-118.
[8] QI Bao-lian, ZHONG Kun-hua and CHEN Yu-wen. Semi-supervised Surgical Video Workflow Recognition Based on Convolution Neural Network [J]. Computer Science, 2020, 47(6A): 172-175.
[9] SUN Min, CHEN Zhong-xiong, YE Qiao-nan. Workflow Scheduling Strategy Based on HEDSM Under Cloud Environment [J]. Computer Science, 2020, 47(6): 252-259.
[10] XU Jun, XIANG Qian-hong, XIAO Gang. Load Balancing Scheduling Optimization of Cloud Workflow Using Improved Shuffled Frog Leaping Algorithm [J]. Computer Science, 2019, 46(11): 315-322.
[11] DU Yan-ming, XIAO Jian-hua. Workflow Scheduling Strategy with Multi-QoS Constraint Based on Priority in Cloud Environment [J]. Computer Science, 2019, 46(10): 128-134.
[12] XU Jian-rui, ZHU Hui-juan. Coevolutionary Genetic Algorithm of Cloud Workflow Scheduling Based on Adaptive Penalty Function [J]. Computer Science, 2018, 45(8): 105-112.
[13] HE Si-yuan, OU Bo, LIAO Xin. Role Matching Access Control Model for Distributed Workflow [J]. Computer Science, 2018, 45(7): 129-134.
[14] ZHENG Hong, DENG Wen-xuan, DENG Xiao, LU Xing-jian. Simplification and Verification of Matrix-based Workflow Logic Net Model [J]. Computer Science, 2018, 45(7): 307-314.
[15] LI Ting-yuan, WANG Bo-yan. Workflow Energy-efficient Scheduling Algorithm in Cloud Environment with QoS Constraint [J]. Computer Science, 2018, 45(6A): 304-309.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.