计算机科学 ›› 2020, Vol. 47 ›› Issue (8): 112-118.doi: 10.11896/jsjkx.200300038

所属专题: 高性能计算

• 高性能计算 • 上一篇    下一篇

基于异构云计算的成本约束下的工作流能量高效调度算法

张龙信, 周立前, 文鸿, 肖满生, 邓晓军   

  1. 湖南工业大学计算机学院 湖南 株洲 412007
  • 出版日期:2020-08-15 发布日期:2020-08-10
  • 通讯作者: 文鸿(wenhhut@163.com)
  • 作者简介:longxinzhang@hut.edu.cn
  • 基金资助:
    国家重点研发计划(2018YFB1003401);国家自然科学基金(61702178, 61672224);湖南省自然科学基金(2019JJ50123, 2020JJ6087, 2019JJ60054, 2018JJ4068);中国国家留学基金(201808430297)

Energy Efficient Scheduling Algorithm of Workflows with Cost Constraint in Heterogeneous Cloud Computing Systems

ZHANG Long-xin, ZHOU Li-qian, WEN Hong, XIAO Man-sheng, DENG Xiao-jun   

  1. School of Computer Science, Hunan University of Technology, Zhuzhou, Hunan 412007, China
  • Online:2020-08-15 Published:2020-08-10
  • About author:ZHANG Long-xin, born in 1983, Ph.D, associate professor, master supervisor, is a member of China Computer Federation.His main research interests include cloud computing, scheduling for distri-buted computing systems and big data analysis.
    WEN Hong, born in 1981, Ph.D, asso-ciate professor, master supervisor, is a member of China Computer Federation.His main research interests include deep learning and network virtualization.
  • Supported by:
    This work was supported by the National Key R&D Program of China(2018YFB1003401), National Natural Science Foundation of China(61702178, 61672224), Natural Science Foundation of Hunan Province(2019JJ50123, 2020JJ6087, 2019JJ60054, 2018JJ4068) and China Scholarship Council(201808430297).

摘要: 云计算已成为各行业中十分重要的计算服务方式。传统的云计算研究主要侧重于云服务的定价方式、利润最大化、执行效率等服务质量, 而绿色计算成为了近年来分布式计算的发展趋势。针对异构云环境中满足云用户计算成本约束的工作流任务集调度问题, 提出了一种低时间复杂度、能量感知的预算等级调度(Energy-Aware Based on Budget Level Scheduling, EABL) 算法。EABL算法包含并行任务集任务优先级的建立、任务预算成本的分配及最优执行虚拟机和能量高效频率的确定3个主要阶段, 能在满足预算成本约束的同时最大限度地降低任务集执行过程中的能量消耗。采用真实世界的大规模工作流任务集对算法进行测试, 结果表明, 与著名的EA_HBCS和MECABP算法相比, EABL算法在充分利用预算成本的同时, 有效地降低了工作流任务集在云数据中心计算过程中的能量消耗。

关键词: 成本约束, 工作流调度, 能量高效, 任务调度, 异构云

Abstract: Cloud computing has become a very important computing service mode in various industries.Traditional studies on cloud computing mainly focus on the research of service quality such as the pricing mode, profit maximization and execution efficiency of cloud services.Green computing is the development trend of distributed computing.Aiming at the scheduling problem of workflow task set that meets the computing cost constraint of cloud users in heterogeneous cloud environment, an energy-aware based on budget level scheduling algorithm(EABL) with low time complexity is proposed.The EABL algorithm consists of three main stages:task priority establishment, task budget cost allocation, optimal execution virtual machine and energy efficiency frequency selection of the parallel task set, so as to minimize the energy consumption during task set execution under the constraint of budget cost.A large-scale workflow task sets in the real world are used to conduct a large number of tests on the algorithm for the experiment in this paper.Compared with famous algorithms EA_HBCS and MECABP, EABL algorithm can effectively reduce the energy consumption in the computing process of cloud data centers by making full use of the budget cost.

Key words: Budget constraint, Energy efficiency, Heterogeneous computing, Task scheduling, Workflow scheduling

中图分类号: 

  • TP301
[1] SHARMA N K, REDDY G R M.Multi-objective energy efficient virtual machines allocation at the cloud data center[J].IEEE Transactions on Services Computing, 2019, 12(1):158-171.
[2] ZHANG L X, LI K L, XU Y M, et al.Maximizing reliability with energy conservation for parallel task scheduling in a hete-rogeneous cluster[J].Information Sciences, 2015, 319:113-131.
[3] MANSOURI Y, TOOSI A N, BUYYA R.Cost optimization fordynamic replication and migration of data in cloud data centers[J].IEEE Transactions on Cloud Computing, 2019, 7(3):705-718.
[4] LI K Q.Scheduling parallel tasks with energy and time con-straints on multiple manycore processors in a cloud computing environment[J].Future Generation Computer Systems, 2018, 82:591-605.
[5] ZHANG X M, JIA M, GU X M, et al.An energy efficient resource allocation scheme based on cloud-computing in H-CRAN[J].IEEE Internet of Things Journal, 2019, 6(3):4968-4976.
[6] ZHANG L X, LI K L, ZHENG W H, et al.Contention-aware reliability efficient scheduling on heterogeneous computing systems[J].IEEE Transactions on Sustainable Computing, 2018, 3(3):182-194.
[7] JUAREZ F, EJARQUE J, BADIA R M.Dynamic energy-aware scheduling for parallel task-based application in cloud computing[J].Future Generation Computer Systems, 2018, 78:257-271.
[8] ZHANG L X, LI K L, LI C Y, et al.Bi-objective workflowscheduling of the energy consumption and reliability in heterogeneous computing systems[J].Information Sciences, 2017, 379:241-256.
[9] SHOJAFAR M, CORDESCHI N, BACCARELLI E.Energy-efficient adaptive resource management for real-time vehicular cloud services[J].IEEE Transactions on Cloud Computing, 2019, 7(1):196-209.
[10]PENG H, WEN W S, TSENG M L, et al.Joint optimizationmethod for task scheduling time and energy consumption in mobile cloud computing environment[J].Applied Soft Computing, 2019, 80:534-545.
[11]LI Z, GE J, HU H, et al.Cost and energy aware scheduling algorithm for scientific workflows with deadline constraint in clouds[J].IEEE Transactions on Services Computing, 2018, 11(4):713-726.
[12]ABRISHAMI S, NAGHIBZADEH M, EPEMA D H J.Dead-line-constrained workflow scheduling algorithms for infrastructure as a service clouds[J].Future Generation Computer Systems, 2013, 29(1):158-169.
[13]ARABNEJAD H, BARBOSA J G.A budget constrained schedu-ling algorithm for workflow applications[J].Journal of Grid Computing, 2014, 12(4):665-679.
[14]CHEN Y K, XIE G Q, LI R F.Reducing energy consumption with cost budget using available budget preassignment inhete-rogeneous cloud computing systems[J].IEEE Access, 2018, 6:20572-20583.
[1] 田冰川, 田臣, 周宇航, 陈贵海, 窦万春.
减少Hadoop集群中网络队头阻塞的调度算法
Reducing Head-of-Line Blocking on Network in Hadoop Clusters
计算机科学, 2022, 49(3): 11-22. https://doi.org/10.11896/jsjkx.210900117
[2] 林潮伟, 林兵, 陈星.
边缘环境下基于模糊理论的科学工作流调度研究
Study on Scientific Workflow Scheduling Based on Fuzzy Theory Under Edge Environment
计算机科学, 2022, 49(2): 312-320. https://doi.org/10.11896/jsjkx.201000102
[3] 谭双杰, 林宝军, 刘迎春, 赵帅.
基于机器学习的分布式星载RTs系统负载调度算法
Load Scheduling Algorithm for Distributed On-board RTs System Based on Machine Learning
计算机科学, 2022, 49(2): 336-341. https://doi.org/10.11896/jsjkx.201200126
[4] 沈彪, 沈立炜, 李弋.
空间众包任务的路径动态调度方法
Dynamic Task Scheduling Method for Space Crowdsourcing
计算机科学, 2022, 49(2): 231-240. https://doi.org/10.11896/jsjkx.210400249
[5] 王政, 姜春茂.
一种基于三支决策的云任务调度优化算法
Cloud Task Scheduling Algorithm Based on Three-way Decisions
计算机科学, 2021, 48(6A): 420-426. https://doi.org/10.11896/jsjkx.201000023
[6] 蔡凌峰, 魏祥麟, 邢长友, 邹霞, 张国敏.
故障场景下的边缘计算DAG任务重调度方法
Failure-resilient DAG Task Rescheduling in Edge Computing
计算机科学, 2021, 48(10): 334-342. https://doi.org/10.11896/jsjkx.210300304
[7] 马堉银, 郑万波, 马勇, 刘航, 夏云霓, 郭坤银, 陈鹏, 刘诚武.
一种基于深度强化学习与概率性能感知的边缘计算环境多工作流卸载方法
Multi-workflow Offloading Method Based on Deep Reinforcement Learning and ProbabilisticPerformance-awarein Edge Computing Environment
计算机科学, 2021, 48(1): 40-48. https://doi.org/10.11896/jsjkx.200900195
[8] 孙敏, 陈中雄, 叶侨楠.
云环境下基于HEDSM的工作流调度策略
Workflow Scheduling Strategy Based on HEDSM Under Cloud Environment
计算机科学, 2020, 47(6): 252-259. https://doi.org/10.11896/jsjkx.190400047
[9] 胡俊钦, 张佳俊, 黄引豪, 陈星, 林兵.
边缘环境下DNN应用的计算迁移调度技术
Computation Offloading Scheduling Technology for DNN Applications in Edge Environment
计算机科学, 2020, 47(10): 247-255. https://doi.org/10.11896/jsjkx.190900106
[10] 张洲, 黄国锐, 金培权.
基于Storm的任务调度:现状与研究展望
Task Scheduling on Storm:Current Situations and Research Prospects
计算机科学, 2019, 46(9): 28-35. https://doi.org/10.11896/j.issn.1002-137X.2019.09.004
[11] 曾金晶, 张建山, 林兵, 张文德.
基于无线城域网的微云负载均衡算法
Cloudlet Workload Balancing Algorithm in Wireless Metropolitan Area Networks
计算机科学, 2019, 46(8): 163-170. https://doi.org/10.11896/j.issn.1002-137X.2019.08.027
[12] 张建山, 林兵, 卢宇, 许芙蓉.
基于无线城域网的微云部署及用户任务调度
Cloudlet Placement and User Task Scheduling Based on Wireless Metropolitan Area Networks
计算机科学, 2019, 46(6): 128-134. https://doi.org/10.11896/j.issn.1002-137X.2019.06.019
[13] 叶符明, 李雯婷, 王颖.
MC2ETS:移动云计算中一种能效任务调度算法
MC2ETS:An Energy-efficient Tasks Scheduling Algorithm in Mobile Cloud Computing
计算机科学, 2019, 46(6): 135-142. https://doi.org/10.11896/j.issn.1002-137X.2019.06.020
[14] 马小晋,饶国宾,许华虎.
云计算中任务调度研究的调查
Research on Task Scheduling in Cloud Computing
计算机科学, 2019, 46(3): 1-8. https://doi.org/10.11896/j.issn.1002-137X.2019.03.001
[15] 王卓昊, 杨冬菊, 徐晨阳.
基于ISE算法的分布式ETL任务调度策略研究
Research on Distributed ETL Tasks Scheduling Strategy Based on ISE Algorithm
计算机科学, 2019, 46(12): 1-7. https://doi.org/10.11896/jsjkx.190100023
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!