Computer Science ›› 2022, Vol. 49 ›› Issue (5): 235-243.doi: 10.11896/jsjkx.210300303

• Computer Network • Previous Articles     Next Articles

Survey of Hybrid Cloud Workflow Scheduling

LIU Peng1, LIU Bo1, ZHOU Na-qin2, PENG Xin-yi3, LIN Wei-wei4   

  1. 1 School of Computer Science,South China Normal University,Guangzhou 510631,China
    2 Institute of Advanced Technology in Cyberspace,Guangzhou University,Guangzhou 510006,China
    3 School of Mathematical Sciences,South China Normal University,Guangzhou 510631,China
    4 School of Computer Science and Engineering,South China University of Technology,Guangzhou 510640,China
  • Received:2021-03-31 Revised:2021-06-06 Online:2022-05-15 Published:2022-05-06
  • About author:LIU Peng,born in 1997,postgraduate.His main research interests include cloud computing and resource scheduling.
    ZHOU Na-qin,born in 1982,Ph.D,lecturer,is a member of China Computer Federation.Her main research interests include distributed computing and resource management scheduling.
  • Supported by:
    National Natural Science Foundation of China(62002078,62072187,61872084),Guangdong Major Project of Basic and Applied Basic Research(2019B030302002) and Guangzhou Science and Technology Plan Project(202007040002,201902010040).

Abstract: In the context of data explosion,traditional cloud computing is faced with the dilemma of insufficient local cloud resources and high expansion cost.However,the newly emerging hybrid cloud combining resource-rich public cloud and data-sensitive private cloud has become a research hotspot and application direction at present.As an attractive paradigm,workflow has been increasing in data scale and computing scale.Therefore,workflow scheduling is a key issue in the direction of hybrid cloud research.For this reason,this paper first makes an in-depth investigation and analysis of workflow scheduling technology in hybrid cloud environment,and then classifies and compares workflow scheduling in hybrid cloud environment:for deadline,for cost,for energy-efficient and for multi-objective constraints.On this basis,the future research directions of workflow scheduling in hybrid cloud environment are analyzed and summarized:workflow scheduling based on Serverless platform,workflow scheduling based on edge server network collaboration,cloud native workflow scheduling based on Argo integration,and workflow scheduling based on fog computing fusion.

Key words: Hybrid cloud, Scheduling of resources, Workflow

CLC Number: 

  • TP393
[1]PARTOVI B,BAGHERI A,KAZARJI M H,et al.Virtual Machine Placement for Edge and Cloud Computing[C]//European Conference on Service-Oriented and Cloud Computing.Cham:Springer,2020:53-64.
[2]MEI J,LI K,OUYANG A,et al.A profit maximization schemewith guaranteed quality of service in cloud computing[J].IEEE Transactions on Computers,2015,64(11):3064-3078.
[3]What is hybrid cloud?[EB/OL].(2019-10-16)[2021-02-01].https://www.ibm.com/cloud/learn/hybrid-cloud.
[4]VAISHNNAVE M,DEVI K S,SRINIVASANP.A survey oncloud computing and hybrid cloud[J].Interence J. Appl. Eng. Res.,2019,14(2):429-434.
[5]Global Cloud Computing Market Size & Share Will Reach USD 1025.9 Billion by 2026:Facts & Factors[EB/OL].(2021-01-22)[2021-02-28].https://www.globenewswire.com/news-release/2021/01/22/2162789/0/en/Global-Cloud-Computing-Market-Size-Share-Will-Reach-USD-1025-9-Billion-by-2026-Facts-Fac-tors.html.
[6]ZHOU J,WANG T,CONG P,et al.Cost and makespan-aware workflow scheduling in hybrid clouds[J].Journal of Systems Architecture,2019,100:101631.
[7]WANG B,WANG C,SONG Y,et al.A survey and taxonomy on workload scheduling and resource provisioning in hybrid clouds[J].Cluster Computing,2020,23(4):2809-2834.
[8]KORNIICHUK M,KARPOV K,FEDOTOVA I,et al.Impactof Xen and Virtual Box virtualization environments on timing precision under stressful conditions[C]//MATEC Web of Conferences.EDP Sciences,2018:02006.
[9]ALGARNI S A,IKBAL M R,ALROOBAEA R,et al.Perfor-mance evaluation of Xen,KVM,and proxmox hypervisors[J].International Journal of Open Source Software and Processes (IJOSSP),2018,9(2):39-54.
[10]Docker:build,manage and secure your apps anywhere.[EB/OL].(2020-11-21)[2021-02-26].http://www.docker.com/.
[11]Alibaba Cloud:an integrated suite of cloud products,services and solutions.[EB/OL].(2020-10-22)[2021-02-26].https://www.alibabacloud.com/.
[12]Amazon Elastic Compute Cloud (Amazon EC2)[EB/OL].(2020-11-21)[2021-02-26].http://aws amazon.com/ec2/.
[13]BITTENCOUR T, FERNANDO L,MADEIR A,et al.HCOC:a cost optimization algorithm for workflow scheduling in hybrid clouds[J].Journal of Internet Services and Applications,2011,2.3:207-227.
[14]YUAN H,BI J,ZHOU M.Temporal task scheduling of multiple delay-constrained applications in green hybrid cloud[J].IEEE Transactions on Services Computing,2021,14(5):1558-1570.
[15]VENKATESAKUMAR V,YASOTHA R,SUBASHINI A.Abrief survey on hybrid cloud storage and its applications[J].World Scientific News,2016,46:219-232.
[16]LIN B,GUO W Z,LIN X Y.Online optimization scheduling for scientific workflows with deadline constraint on hybrid clouds[J].Concurrency and Computation:Practice and Experience,2016,28.11:3079-3095.
[17]CASAS I,TAHERI J,RANJAN R,et al.PSO-DS:a scheduling engine for scientific workflow managers[J].The Journal of Super-computing,2017,73(9):3924-3947.
[18]PASDAR A,LEE Y C,ALMI’ANI K.Hybrid scheduling for scientific workflows on hybrid clouds[J].Computer Networks,2020,181:107438.
[19]BALAGONI Y,RAO R R.A cost-effective SLA-aware scheduling for hybrid cloud environment[C]//2016 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC).IEEE,2016:1-7.
[20]XU L,DUAN J W,HUANG M.Research on hybrid cloud particle swarm optimization for multi-objective flexible job shop scheduling problem[C]//2017 6th International Conference on Computer Science and Network Technology(ICCSNT).IEEE,2017:274-278.
[21]DAS A,LEAF A,VARELA C A,et al.Skedulix:Hybrid Cloud Scheduling for Cost-Efficient Execution of Serverless Applications[C]//2020 IEEE 13th International Conference on Cloud Computing(CLOUD).IEEE,2020:609-618.
[22]ZUO L Y,SHU L,DONG S B,et al.A multi-objective hybrid cloud resource scheduling method based on deadline and cost constraints[J].IEEE Access,2016,5:22067-22080.
[23]FAN Y,LIANG Q,CHEN Y,et al.Executing time and cost-aware task scheduling in hybrid cloud using a modified DE algorithm[J].International Journal of Computational Science and Engineering,2019,18(3):217-226.
[24]KRISHNAN P,ARAVIDHAR D J.Self-adaptive PSO memetic algorithm for multi objective workflow scheduling in hybrid cloud[J].Interence Arab J.Inf.Technol.,2019,16(5):928-935.
[25]HAMED A A,AHMED R A.Availability evaluation of differentplanning and scheduling algorithms in hybrid cloud system[J].Iraqi Journal of Information & Communications Technology,2020,3(4):47-59.
[26]MS S,PM J P,ALAPPATT V.Profit maximization based task scheduling in hybrid clouds using whale optimization technique[J].Information Security Journal:A Global Perspective,2020,29(4):155-168.
[27]SHARIF S,TAHERI J,ZOMAYA A Y,et al Online multiple workflow scheduling under privacy and deadline in hybrid cloud environment[C]//2014 IEEE 6th International Conference on Cloud Computing Technology and Science.IEEE,2014:455-462.
[28]HU W,LI X,LI X.Hybrid Cloud Workflow Scheduling Method With Privacy Data[J].IEEE Access,2020,8:211540-211552.
[29]LI C L,TANG J H,LUO Y L.Hybrid cloud adaptive scheduling strategy for heterogeneous workloads[J].Journal of Grid Computing,2019,17(3):419-446.
[30]PANDA S K,JANA P K.Uncertainty-based QoS min-min algorithm for heterogeneous multi-cloud environment[J].Arabian Journal for Science and Engineering,2016,41(8):3003-3025.
[31]LENINFRED A,DHANYA D,KAVITHA S,et al.Hybrid algorithm for resource provisioning with low cost and time using improved cost-based algorithm in hybrid cloud computing[J].Journal of Intelligent & Fuzzy Systems,2019,37(3):3981-3990.
[32]CHANG Y S,FAN C T,SHEU R K,et al.An agent-based workflow scheduling mechanism with deadline constraint on hybrid cloud environment[J].International Journal of Communication Systems,2018,31(1):e3401.
[33]IRANMANESH A,NAJI H R.DCHG-TS:a deadline-constrainedand cost-effective hybrid genetic algorithm for scientific workflow scheduling in cloud computing[J].Cluster Computing,2021,24(2):667-681.
[34]LIU W,DU W,CHEN J,et al.Adaptive energy-efficient scheduling algorithm for parallel tasks on homogeneous clusters[J].Journal of Network and Computer Applications,2014,41:101-113.
[35]RAJU R,AMUDHAVEL J,KANNAN N,et al.A bio inspired Energy-Aware Multi objective Chiropteran Algorithm(EAMOCA) for hybrid cloud computing environment[C]//2014 International Conference on Green Computing Communication and Electrical Engineering(ICGCCEE).IEEE,2014:1-5.
[36]BITTENCOURT L,MADEIR A,EDMUNDO R M.A perfor-mance-oriented adaptive scheduler for dependent tasks on grids[J].Concurrency and Computation:Practice and Experience,2008,20.9:1029-1049.
[37]LIU Z,XIANG T,LIN B,et al.A data placement strategy for scientific workflow in hybrid cloud[C]//2018 IEEE 11th International Conference on Cloud Computing(CLOUD).IEEE,2018:556-563.
[38]BALDINI I,CASTRO P,CHANG K,et al.Serverless compu-ting:Current trends and open problems[M]//Research Advances in Cloud Computing.Singapore:Springer,2017:1-20.
[39]Minio:High Performance,Kubernetes-Friendly Object Storage[EB/OL].(2020-11-21)[2021-02-15].https://min.io.
[40]How Much Energy Do Data Center Really User?[EB/OL].(2020-03-17)[2021-01-26].https://energyinnovation.org/2020/03/17/how-much-energy-do-data-centers-really-use/.
[41]HADOOP,Apache.Apache Hadoop[EB/OL].(2020-07-14)[2021-2-27].https://hadoop.apache.org/.
[42]RICHARD M K.Effective heuristics for NP-hard problems[EB/OL].(2011-10-17)[2021-01-6].https://www.youtube.com/watch?v=0p5NilbKETI.
[43]KINTSAKIS A M,PSOMOPOULOS F E,SYMEONIDIS A L,et al.Hermes:Seamless delivery of containerized bioinformatics workflows in hybrid cloud (HTC) environments[J].SoftwareX,2017,6:217-224.
[44]ZHU J,LI X,RUIZ R,et al.Scheduling stochastic multi-stage jobs to elastic hybrid cloud resources[J].IEEE Transactions on Parallel and Distributed Systems,2018,29(6):1401-1415.
[45]LI C L,LI LY.Optimal scheduling across public and private clouds in complex hybrid cloud environment[J].Information Systems Frontiers,2017,19(1):1-12.
[46]LI J,DING D,LI T.Multi-objective hybrid cloud task scheduling using twice clustering[J].Journal of Zhejiang University (Engineering Science),2017,51(6):1233-1241.
[47]ZHANG M,KRINTZ C,WOLSKI R.STOIC:Serverless Teleoperable Hybrid Cloud for Machine Learning Applications on Edge Device[C]//2020 IEEE International Conference on Pervasive Computing and Communications Workshops(PerCom Workshops).IEEE,2020:1-6.
[48]HUANG H,LING Q,SHI W,et al.Collaborative resource allocation over a hybrid cloud center and edge server network[J].Journal of Computational Mathematics,2017,35(4):423-438.
[49]XU X,CAO H,GENG Q,et al.Dynamic resource provisioning for workflow scheduling under uncertainty in edge computing environment[J/OL].Concurrency and Computation:Practice and Experience,2020:e5674.https://onlinelibrary.wiley.com/doi/full/10.1002/cpe.5674?casa_token=VAyobWre1y8AAAAA%3Annavap3-V3FAZak3Qp_jDQz0gQLo_md0uu5TD_9Y9B7nC6HpBgFCrQnqOpJsPwY9tpEq9fjBSiByYoK5.
[50]LU X,LIAO Y,LIO P,et al.Privacy-preserving asynchronousfederated learning mechanism for edge network computing[J].IEEE Access,2020,8:48970-48981.
[51]Argo Project Homepage[EB/OL].(2020-10-14)[2021-02-28].https://argoproj.github.io/projects/argo/.
[52]Kubernetes Project Homepage.[EB/OL].(2020-10-14)[2021-02-28].https://kubernetes.io/.
[53]Why the need for container-native workflow?[EB/OL].(2017-09-16)[2021-02-28].https://applatix.com/benefits-container-native-workflows/.
[54]ADHIKARI M,AMGOTH T,SRIRAMAS N.A survey onscheduling strategies for workflows in cloud environment and emerging trends[J].ACM Computing Surveys (CSUR),2019,52(4):1-36.
[55]LIU X,FAN L,XU J,et al.FogWorkflowSim:an automated simulation toolkit for workflow performance evaluation in fog computing[C]//2019 34th IEEE/ACM International Confe-rence on Automated Software Engineering(ASE).IEEE,2019:1114-1117.
[1] YAN Lei, ZHANG Gong-xuan, WANG Tian, KOU Xiao-yong, WANG Guo-hong. Scheduling Algorithm for Bag-of-Tasks with Due Date Constraints on Hybrid Clouds [J]. Computer Science, 2022, 49(5): 244-249.
[2] LIN Chao-wei, LIN Bing, CHEN Xing. Study on Scientific Workflow Scheduling Based on Fuzzy Theory Under Edge Environment [J]. Computer Science, 2022, 49(2): 312-320.
[3] DOU Shuai, LI Zi-yang, ZHU Jia-jia, LI Xiao-hui, LI Xue-song, MI Lin, YANG Guang, LI Chuan-rong. Design and Implementation of Scientific Experiment Management System Based on jBPM [J]. Computer Science, 2021, 48(6A): 658-663.
[4] JI Yan, DAI Hua, JIANG Ying-ying, YANG Geng, Yi Xun. Parallel Multi-keyword Top-k Search Scheme over Encrypted Data in Hybrid Clouds [J]. Computer Science, 2021, 48(5): 320-327.
[5] LIU Zhang-hui, ZHAO Xu, LIN Bing, CHEN Xing. Data Placement Strategy of Scientific Workflow Based on Fuzzy Theory in Hybrid Cloud [J]. Computer Science, 2021, 48(11): 199-207.
[6] MA Yu-yin, ZHENG Wan-bo, MA Yong, LIU Hang, XIA Yun-ni, GUO Kun-yin, CHEN Peng, LIU Cheng-wu. Multi-workflow Offloading Method Based on Deep Reinforcement Learning and ProbabilisticPerformance-awarein Edge Computing Environment [J]. Computer Science, 2021, 48(1): 40-48.
[7] ZHANG Long-xin, ZHOU Li-qian, WEN Hong, XIAO Man-sheng, DENG Xiao-jun. Energy Efficient Scheduling Algorithm of Workflows with Cost Constraint in Heterogeneous Cloud Computing Systems [J]. Computer Science, 2020, 47(8): 112-118.
[8] QI Bao-lian, ZHONG Kun-hua and CHEN Yu-wen. Semi-supervised Surgical Video Workflow Recognition Based on Convolution Neural Network [J]. Computer Science, 2020, 47(6A): 172-175.
[9] SUN Min, CHEN Zhong-xiong, YE Qiao-nan. Workflow Scheduling Strategy Based on HEDSM Under Cloud Environment [J]. Computer Science, 2020, 47(6): 252-259.
[10] HUANG Yin-hao, MA Yun, LIN Bing, YU Zhi-yong, CHEN Xing. Cost-driven Workflow Data Placement Method in Hybrid Cloud Environment [J]. Computer Science, 2019, 46(11A): 354-358.
[11] XU Jun, XIANG Qian-hong, XIAO Gang. Load Balancing Scheduling Optimization of Cloud Workflow Using Improved Shuffled Frog Leaping Algorithm [J]. Computer Science, 2019, 46(11): 315-322.
[12] DU Yan-ming, XIAO Jian-hua. Workflow Scheduling Strategy with Multi-QoS Constraint Based on Priority in Cloud Environment [J]. Computer Science, 2019, 46(10): 128-134.
[13] XU Jian-rui, ZHU Hui-juan. Coevolutionary Genetic Algorithm of Cloud Workflow Scheduling Based on Adaptive Penalty Function [J]. Computer Science, 2018, 45(8): 105-112.
[14] HE Si-yuan, OU Bo, LIAO Xin. Role Matching Access Control Model for Distributed Workflow [J]. Computer Science, 2018, 45(7): 129-134.
[15] ZHENG Hong, DENG Wen-xuan, DENG Xiao, LU Xing-jian. Simplification and Verification of Matrix-based Workflow Logic Net Model [J]. Computer Science, 2018, 45(7): 307-314.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!