计算机科学 ›› 2018, Vol. 45 ›› Issue (1): 196-199.doi: 10.11896/j.issn.1002-137X.2018.01.034

• 网络与通信 • 上一篇    下一篇

全局负载均衡下云环境中的大数据动态迁移方法

章勇,张洁卉,柳斌   

  1. 华中科技大学网络与计算中心 武汉430074,华中科技大学网络与计算中心 武汉430074,华中科技大学网络与计算中心 武汉430074
  • 出版日期:2018-01-15 发布日期:2018-11-13
  • 基金资助:
    本文受华中科技大学自主创新基金项目(2015MS139), 国家自然科学基金:3D H.264视频的无帧内失真漂移隐写方法研究(61272407)资助

Big Data Dynamic Migration Method Based on Global Load Balancing in Cloud Environment

ZHANG Yong, ZHANG Jie-hui and LIU Bin   

  • Online:2018-01-15 Published:2018-11-13

摘要: 在云环境中,数据负载均衡化速度较慢且易出现数据倾斜,这严重干扰了系统状态。为了减小数据迁移的代价,提出一种在全局负载均衡下云环境中的大数据动态迁移方法。首先构造负载均衡模型,在均衡负载下计算数据迁移成本,并给出最小数据迁移成本模型。计算数据迁移成本并评估虚拟机数据负载资源利用率,从而使数据重载的服务器转移到数据轻载的服务器上,达到云环境中的数据均衡化。仿真实验结果证明,所提方法提高了数据负载的均衡化速度和均衡效率,降低了数据迁移成本,且提高了资源利用率。

关键词: 负载均衡,资源利用率,数据迁移

Abstract: In the cloud environment,the data load equalization is slow and the data skew.In order to reduce the cost of data transfer,a global load balancing method of dynamic data migration under the cloud environment was proposed.First,load balancing model was constructed,data migration cost was computed in load balancing,and the minimum cost of data migration model was given.The cost of data transfer was calculated,and the utilization ratio of virtual machine data load was evaluated so that the data overloaded server can be transferred to the data server.The simulation results show that the proposed method improves the speed and efficiency of data load balancing,reduces the cost of data migration,and improves the utilization ratio of resources.

Key words: Load balancing,Resource utilization ratio,Data migration

[1] GUO G,YU J,LV L,et al(1)Data migration model based onRAMCloud hierarchical storage architecture[J].Journal of Computer Applications,2015,5(12):3392-3397.(in Chinese) 郭刚,于炯,鲁亮,等.内存云分级存储架构下的数据迁移模型[J].计算机应用,2015,5(12):3392-3397.
[2] CUI L L,ZHU G F.The Research on Using the Method to Restore Earth’s Mass Migration Based on Gravity Satellite Data[J].Science Technology and Engineering,2015,5(14):106-109.(in Chinese) 崔立鲁,朱贵发.利用重力卫星数据恢复地球质量迁移方法的研究[J].科学技术与工程,2015,5(14):106-109.
[3] WU J,ZAHNG Y J,BAI G W.Dynamic optimization research strategy based on Xen virtual machine migration[J].Application of Electronic Technique,2015,1(11):128-131.(in Chinese) 吴军,张轶君,白光伟.Xen下虚拟机动态迁移优化策略的研究[J].电子技术应用,2015,1(11):128-131.
[4] FAN W,KONG B,ZHANG Z J,et al(1)Security Protection Model on Live Migration for KVM Virtualization[J].Journal of Software,2016,7(6):1402-1416.(in Chinese) 范伟,孔斌,张珠君,等.KVM虚拟化动态迁移技术的安全防护模型[J].软件学报,2016,7(6):1402-1416.
[5] GUO J Q,HAN Y.Load balancing algorithm for non-uniformclustering with distributed hierarchical structure[J].Journal of Computer Applications,2015,5(2):332-335.(in Chinese) 郭晋秦,韩焱.基于分布式层次化结构的非均匀聚类负载均衡算法[J].计算机应用,2015,5(2):332-335.
[6] LIANG Z Y,SHEN W.Design and implementation of channe-lized receiver based on FPGA[J].Electronic Design Enginee-ring,2016,4(10):147-149.(in Chinese) 梁中英,沈炜.基于FPGA的信道化接收机设计及工程应用[J].电子设计工程,2016,4(10):147-149.
[7] DENG F F,YUAN H M.Technology Flow Status of Chinese Medicine Industry:Patent Transfer’s Data as Samples[J].Journal of Intelligence,2016,5(6):91-95.(in Chinese) 邓飞飞,袁红梅.中国中药产业技术流动状态分析--以专利转移数据为样本[J].情报杂志,2016,5(6):91-95.
[8] YANG S,WANG Y L,WANG Y L.Load balancing algorithm of task scheduling in cloud computing environment based on honey bee behavior[J].Journal of Computer Applications,2015,5(4):938-943.(in Chinese) 杨石,王艳玲,王永利.云计算环境下基于蜜蜂觅食行为的任务负载均衡算法[J].计算机应用,2015,5(4):938-943.
[9] PAN M Y,GAO L J,SONG P L,et al(1)MongoDB based ship database construction and batch migration technology of its data[J].Journal of Dalian Maritime University,2016,2(1):39-44.(in Chinese) 潘明阳,高立佳,宋平亮,等.基于MongoDB的船舶数据库构建与数据批量迁移技术[J].大连海事大学学报,2016,2(1):39-44.
[10] KANG Y,ZHAO Y B.Dynamic data packing towards theoptimization of QoC and QoS in networked control systems[J].Science China Technological Sciences,2016,9(1):1-9.
[11] YOU Z,CHEN S,WANG Y.Novel dynamic data aggregationscheme for WSN based intelligent vehicle systems[J].Intelligent Decision Technologies,2016,0(2):105-114.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!