云计算环境下分布式文件系统的负载平衡研究

计算机科学 ›› 2014, Vol. 41 ›› Issue (3): 141-144.

云计算环境下分布式文件系统的负载平衡研究

尹向东,杨杰,屈长青

湖南科技学院计算机与通信工程系永州425100;湖南科技学院计算机与通信工程系永州425100;湖南科技学院计算机与通信工程系永州425100

出版日期:2018-11-14 发布日期:2018-11-14
基金资助:
本文受湖南省自然科学基金(11JJ6065),湖南省教育厅科研项目(12C0681,10C0732)资助

Research on Load Balancing of Distributed File System in Cloud Computing

YIN Xiang-dong,YANG Jie and QU Chang-qing

Online:2018-11-14 Published:2018-11-14

摘要/Abstract

摘要： 在云计算环境下,文件以块的形式分布在文件系统中。然而系统状态的更新,如节点加入和离开,会导致文件块在系统中的分布不均衡,从而对系统执行的任务产生性能上的影响。针对该分布式文件系统的文件分布不均衡问题,提出了一种完全分布式的负载平衡算法,并采用了仿真实验对所提出的算法与集中式和分布式的负载均衡算法进行了对比。结果表明,该算法在解决了集中式算法的单点瓶颈的基础上只增加了少量的额外开销,其性能明显优于分布式的负载均衡算法。

关键词: 负载均衡,分布式文件系统,云计算,算法中图法分类号TP312文献标识码A

Abstract: In cloud computing,the files are divided into chucks,and stored in distributed file system．However,the updates of the system states,such as node joining and leaving,will cause an unbalancing distribution of file chunks in the distributed file system,thereby degrading the system performance a lot．For solving this problem,this paper proposed a distributed load balancing algorithm,and compared it with the centralized and distributed load balancing algorithms．The experiments show that the proposed algorithm increases only a little overhead while solving the single point bottleneck of the centralized algorithm,and it has obviously better performance than the distributed load balancing algorithm.

Key words: Load balancing,Distributed file system,Cloud computing,Algorithm

尹向东,杨杰,屈长青. 云计算环境下分布式文件系统的负载平衡研究[J]. 计算机科学, 2014, 41(3): 141-144. https://doi.org/

YIN Xiang-dong,YANG Jie and QU Chang-qing. Research on Load Balancing of Distributed File System in Cloud Computing[J]. Computer Science, 2014, 41(3): 141-144. https://doi.org/

参考文献

[1] Dean J,Ghemawat S．MapReduce:simplified data processing onlarge clusters[J]．Communications of the ACM,2008,51(1):107-113
[2] Ghemawat S,Gobioff H,Leung S T．The Google file system[C]∥ACM SIGOPS Operating Systems Review．ACM,2003,37(5):29-43
[3] VMware．http://www.vmware.com/,2013
[4] Xen．http://www.xen.org/,2013
[5] Hsiao H,Chung H,Shen H,et al．Load Rebalancing for Distri-buted File Systems in Clouds[J]． Appplied Soft Computing,2012,21:102-105
[6] Vu Q H,Ooi B C,Rinard M,et al．Histogram-based global load balancing in structured peer-to-peer systems[J]．IEEE Transactions on Knowledge and Data Engineering,2009,21(4):595-608
[7] Hsiao H C,Liao H,Chen S T,et al．Load Balance with Imperfect Information in Structured Peer-to-Peer Systems[J]．IEEE Transactions on Parallel and Distributed Systems,2011,22(4):634-649
[8] Jones P,Eastlake D E．US secure hash algorithm 1(SHA1)[J]．Networking,IEEE/ACM Transactions on,2001:902-910
[9] Raab M,Steger A．“Balls into Bins”—A Simple and Tight Ana-lysis[M]．Randomization and Approximation Techniques in Computer Science,Springer Berlin Heidelberg,1998:159-170
[10] Jelasity M,Montresor A,Babaoglu O．Gossip-based aggregation in large dynamic networks [J]．ACM Transactions on Computer Systems (TOCS),2005,23(3):219-252
[11] Jelasity M,Voulgaris S,Guerraoui R,et al．Gossip-based peer sampling [J]．ACM Transactions on Computer Systems (TOCS),2007,25(3):8
[12] Stoica I,Morris R,Liben-Nowell D,et al．Chord:a scalable peer-to-peer lookup protocol for internet applications [J]．IEEE/ACM Transactions on Networking,2012,11(1):17-32
[13] Rowstron A,Druschel P．Pastry:Scalable,decentralized objectlocation,and routing for large-scale peer-to-peer systems[C]∥Middleware 2001．Springer Berlin Heidelberg,2011:329-350
[14] Rao A,Lakshminarayanan K,Surana S,et al．Load balancing in structured P2P systems[M]．Peer-to-Peer Systems II,Springer Berlin Heidelberg,2003:68-79
[15] Jin X,Chan S-H G,Wong W-C,et al.A Distributed Protocol to Serve Dynamic Groups for Peer-to-Peer Streaming[J].IEEE Transactions on Parallel and Distributed Systems,2010,1:216-228
[16] Bryhni H.A comparison of load balancing techniques for scalable Web servers[J].IEEE Network,2000,4(4):58-64

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed