Computer Science ›› 2013, Vol. 40 ›› Issue (4): 91-95.

Previous Articles     Next Articles

Hierarchical Scheduling of Large Scale Distributed Computation

QIN Gao-de and WEN Gao-jin   

  • Online:2018-11-16 Published:2018-11-16

Abstract: With the rapid development of cloud computing,large scale distributed computation is used widely.However,recently,energy consumption of such distributed systems has become problem for further application.Existing methods for saving energy are developed mainly by decreasing the amount of running servers.However,these approaches do not consider the energy cost on network devices.This paper proposed a hierarchical scheduling algorithm.Our algorithm employs a dynamic maximum node sorting (DMNS) method to optimize the assignment of applications on servers which are connected to a switch in the same level.Secondly,we transfered the applications on the nodes with low load to the nodes which can handle more application in order to reduce the number of nodes.In addition,we chose the transfer path which bears less capacity of data exchange and less length which helps to reduce the energy consumption of network.As a result,both the running servers and the data transfer can be greatly reduced.The time complexity of HSA is satisfactory,and its stability is verified through simulations.Experimental results show that the performance of HSA outperforms existing methods.

Key words: Distributed computing,Energy-saving schedule,HAS,KMNS,DMNS

[1] 林伟伟,齐德昱.云计算资源调度研究综述[J].计算机科学,2012,9(10):1-6
[2] Orgerie A-C,Lefevre L,Gelas J-P.Demystifying energy con-sumption in Grids and Clouds[A]∥Green Computing Confe-rence,2010International,2010[C].Chicago,IL:IEEE Confe-rence Publications,2010:335-342
[3] Chase J S,Anderson D C,Thakar P N,et al.Managing energy and server resources in hosting centers[A]∥Proceedings of the eighteenth ACM symposium on Operating systems principles (SOSP’01),2001[C].New York,NY,USA:ACM,2001:103-116
[4] Yao C-C.New algorithm for bin-packing[J].Journal of ACM,1980,27(2):207-227
[5] Verma A,Ahuia P,Neoqi A.Power-aware dynamic placement of HPC applications[A]∥Proceedings of the 22nd annual international conference on Supercomputing (ICS’08),2008[C].New York,NY,USA:ACM,2008:175-184
[6] Johnson D.Near-Optimal Bin Packing Algorithms[M].MIT,Cambridge,Massachusetts,1973:56
[7] Gambosi G,Postiglione A,Talamo M.Algorithms for the re-laxed online bin-packing model[J].SIAM Journal on Computing,2000,30(5):1532-1551
[8] Sanders P,Sivadasan N,Skutella M.Online Scheduling withBounded Migration[J].Mathematics of Operations Research,2009,34(2):481-498
[9] Srikantaiah S,Kansal A,Zhao Feng.Energy aware consolidation for cloud computing[A]∥Proceedings of the 2008conference on Power aware computing and systems (HotPower’08),2008[C].Berkeley,CA,USA,USENIX Association,2008:10
[10] Johnson D S,Demers A,Ullman J D.et al.Worst-case Perfor-mance Bounds for Simple One-Dimensional Packing Algorithms[J].SZAM Journal on Computing,1974,3(4):299-325
[11] Baliga J,Ayre R W A,Hinton K.et al.Green Cloud Computing:Balancing Energy in Processing,Storage,and Transport[J].Proceedings of the IEEE,2011,99(1):149-167
[12] Younge A J,von Laszewski G,Wang Li-zhe,et al.Efficient resource management for Cloud computing environments[A]∥Proceedings of the International Conference on Green Computing (GREENCOMP’10),2010[C].Washington,DC,USA,IEEE Computer Society,2010:357-364

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!