计算机科学 ›› 2013, Vol. 40 ›› Issue (4): 91-95.

• 网络与通信 • 上一篇    下一篇

大型分布式计算中的分级节能调度

秦高德,文高进   

  1. 深圳职业技术学院计算机工程学院深圳518055;中科院自动化研究所模式识别国家重点实验室北京100190
  • 出版日期:2018-11-16 发布日期:2018-11-16
  • 基金资助:
    本文受国家高科技研发863计划(2009AA01A129-2),广东省科技计划(2010A090100028,201120510102),国家自然科学基金(60903116),中国科学院知识创新计划(KGCX2-YW-131)以及深圳市科技计划(JC200903170443A,ZD201006100023A,ZYC201006130310A)资助

Hierarchical Scheduling of Large Scale Distributed Computation

QIN Gao-de and WEN Gao-jin   

  • Online:2018-11-16 Published:2018-11-16

摘要: 随着云计算的快速发展,大型分布式计算被广泛应用。但是,其运行时的巨大能量消耗已经成为应用推广的难题。目前的节能研究主要提出通过调度来减少服务器的运行数量以节能,而没有考虑网络的能耗。提出的分级调度算法HAS(Hierarchical Scheduling Algorithm)针对各计算节点间可能出现任务调度的情况,以DMNS(Dynamic Maxi-mum Node Sorting)调度方法将这些应用尽量分配到连接到同一级交换机的服务器中,然后,将应用数量少的计算节点上的任务转移到还能增加任务的节点,从而减少节点的数量。同时,调度时选择的是较少的数据交换量和较短的交换路径,以节约网络能耗。HAS算法的复杂度较好,且其稳定性也通过计算仿真得到验证。通过仿真数据对比表明,HAS比目前的其它方法更优。

关键词: 分布式计算,节能调度,HAS,KMNS,DMNS

Abstract: With the rapid development of cloud computing,large scale distributed computation is used widely.However,recently,energy consumption of such distributed systems has become problem for further application.Existing methods for saving energy are developed mainly by decreasing the amount of running servers.However,these approaches do not consider the energy cost on network devices.This paper proposed a hierarchical scheduling algorithm.Our algorithm employs a dynamic maximum node sorting (DMNS) method to optimize the assignment of applications on servers which are connected to a switch in the same level.Secondly,we transfered the applications on the nodes with low load to the nodes which can handle more application in order to reduce the number of nodes.In addition,we chose the transfer path which bears less capacity of data exchange and less length which helps to reduce the energy consumption of network.As a result,both the running servers and the data transfer can be greatly reduced.The time complexity of HSA is satisfactory,and its stability is verified through simulations.Experimental results show that the performance of HSA outperforms existing methods.

Key words: Distributed computing,Energy-saving schedule,HAS,KMNS,DMNS

[1] 林伟伟,齐德昱.云计算资源调度研究综述[J].计算机科学,2012,9(10):1-6
[2] Orgerie A-C,Lefevre L,Gelas J-P.Demystifying energy con-sumption in Grids and Clouds[A]∥Green Computing Confe-rence,2010International,2010[C].Chicago,IL:IEEE Confe-rence Publications,2010:335-342
[3] Chase J S,Anderson D C,Thakar P N,et al.Managing energy and server resources in hosting centers[A]∥Proceedings of the eighteenth ACM symposium on Operating systems principles (SOSP’01),2001[C].New York,NY,USA:ACM,2001:103-116
[4] Yao C-C.New algorithm for bin-packing[J].Journal of ACM,1980,27(2):207-227
[5] Verma A,Ahuia P,Neoqi A.Power-aware dynamic placement of HPC applications[A]∥Proceedings of the 22nd annual international conference on Supercomputing (ICS’08),2008[C].New York,NY,USA:ACM,2008:175-184
[6] Johnson D.Near-Optimal Bin Packing Algorithms[M].MIT,Cambridge,Massachusetts,1973:56
[7] Gambosi G,Postiglione A,Talamo M.Algorithms for the re-laxed online bin-packing model[J].SIAM Journal on Computing,2000,30(5):1532-1551
[8] Sanders P,Sivadasan N,Skutella M.Online Scheduling withBounded Migration[J].Mathematics of Operations Research,2009,34(2):481-498
[9] Srikantaiah S,Kansal A,Zhao Feng.Energy aware consolidation for cloud computing[A]∥Proceedings of the 2008conference on Power aware computing and systems (HotPower’08),2008[C].Berkeley,CA,USA,USENIX Association,2008:10
[10] Johnson D S,Demers A,Ullman J D.et al.Worst-case Perfor-mance Bounds for Simple One-Dimensional Packing Algorithms[J].SZAM Journal on Computing,1974,3(4):299-325
[11] Baliga J,Ayre R W A,Hinton K.et al.Green Cloud Computing:Balancing Energy in Processing,Storage,and Transport[J].Proceedings of the IEEE,2011,99(1):149-167
[12] Younge A J,von Laszewski G,Wang Li-zhe,et al.Efficient resource management for Cloud computing environments[A]∥Proceedings of the International Conference on Green Computing (GREENCOMP’10),2010[C].Washington,DC,USA,IEEE Computer Society,2010:357-364

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!