基于自适应虚拟机迁移的云资源调度机制

doi:10.11896/jsjkx.190900189

摘要/Abstract

摘要： 虚拟机迁移是当前云计算资源调度的重要研究方向之一。目前,用户规模的不断增长带来了一些新的挑战,传统迁移策略很难适应动态变化的内外部环境。对此,设计了自适应虚拟机迁移的总体框架,通过对虚拟机迁移建模,提出了“迁移路径”和“服务开销”等概念,并以服务器的CPU利用率和服务器间的带宽利用率为指标,为系统中所有迁移的虚拟机规划最优的迁移路径,以使系统总的服务开销最小化。首先,设计了基于阈值的虚拟机筛选算法来挑选可迁移的虚拟机;接着,设计了基于自回归积分滑动平均模型的时间序列预测算法,用以预测服务器未来时间窗口内的服务开销;然后,利用动态规划基于服务器服务开销的预测值设计了迁移路径计算算法,为每个待迁移虚拟机规划出最优的迁移方案;最后,利用迁移路径下服务器服务开销的预测值与真实值之间的差距所反映出的预测窗口性能的优劣,设计并实现了一个预测窗口自适应调整算法。实验表明,该自适应虚拟机迁移算法在自适应性调整和最小化服务开销等方面具有良好的效果。

关键词: ARIMA模型, 动态规划, 虚拟机迁移, 预测窗口, 自适应

Abstract: Virtual machine (VM) migration is an important research field of current cloud computing resource scheduling.Now the continuous growth of users has brought some new challenges,and current typical migration strategies are difficult to adapt to dynamically changing internal and external environments.Aiming at this problem,this paper proposed an overall framework of adaptive VM migration.Via modeling VM migration,the concepts of “migration path” and “service overhead” were proposed,and the server’s CPU utilization and bandwidth utilization of links between servers were used as indicators to plan the optimal migration path for all to-be-migrated VMs in the system to minimize the total service overhead.Firstly,a threshold-based selection algorithm is presented for the selection of the to-be-migrated VMs.Secondly,an auto regressive integrated moving average model (ARIMA)-based time series prediction algorithm is designed to predict the service overhead within the server’s future time window.Then,the migration path calculation algorithm is designed based on servers’ predicted service overhead and dynamic programming,and an optimal migration plan is made for each to-be-migrated VM.Finally,based on the performance of the prediction window determined by the difference between the predicted service overhead and the real value via the migration path,a prediction window adaptive adjustment algorithm is designed and implemented.Experiments prove that the adaptive VM migration has good effects in terms of adaptive adjustment and minimizing service overhead.

Key words: Adaptive, ARIMA, Dynamic programming, Prediction window, VM migration

中图分类号:

TP302

李双刚, 张爽, 王兴伟. 基于自适应虚拟机迁移的云资源调度机制[J]. 计算机科学, 2020, 47(9): 238-245. https://doi.org/10.11896/jsjkx.190900189

LI Shuang-gang, ZHANG Shuang, WANG Xing-wei. Cloud Resource Scheduling Mechanism Based on Adaptive Virtual Machine Migration[J]. Computer Science, 2020, 47(9): 238-245. https://doi.org/10.11896/jsjkx.190900189

参考文献

[1] XU C J,DUAN B Y,XU H P,et al.A Data Center research based on Cloud computing[C]//2011 International Conference on Computer Science and Network Technology.2011:808-811.
[2] CHEN T,GAO X,CHEN G.The features,hardware,and architectures of data center networks:A survey[J].Journal of Parallel and Distributed Computing,2016,96:45-74.
[3] WANG X W,SUN J J,LI H X,et al.A Reverse Auction Based Allocation Mechanism in the Cloud Computing Environment[J].Applied Mathematics and Information Sciences,2013,7(1):75-84.
[4] ZHANG X Z,HUANG Z Y,WU C,et al.Online Auctions inIaaS Clouds:Welfare and Profit Maximization With Server Costs[J].IEEE/ACM Transactions on Networking,2017,25(2):1034-1047.
[5] JIN A L,SONG W,ZHUANG W H.Auction-Based Resource Allocation for Sharing Cloudlets in Mobile Cloud Computing[J].IEEE Transactions on Emerging Topics in Computing,2018,6(1):45-57.
[6] JIANG C X,CHEN Y,WANG Q,et al.Data-Driven AuctionMechanism Design in IaaS Cloud Computing[J].IEEE Transactions on Services Computing,2018,11(5):743-756.
[7] WANG X W,WANG X Y,CHE H,et al.An Intelligent Economic Approach for Dynamic Resource Allocation in Cloud Services[J].IEEE Transactions on Cloud Computing,2015,3(3):275-289.
[8] PILLAI P S,RAO S.Resource Allocation in Cloud Computing Using the Uncertainty Principle of Game Theory[J].IEEE Systems Journal,2016,10(2):637-648.
[9] ZHANG H Q,XIAO Y,BU S R,et al.Computing Resource Allocation in Three-Tier IoT Fog Networks:A Joint Optimization Approach Combining Stackelberg Game and Matching[J].IEEE Internet of Things Journal,2017,4(5):1204-1215.
[10] WANG H B,KANG Z L,WANG L.Performance- Aware Cloud Resource Allocation via Fitness-Enabled Auction[J].IEEE Transactions on Parallel and Distributed Systems,2016,27(4):1160-1173.
[11] AL-TARAZI M,CHANG J M.Performance-Aware EnergySaving for Data Center Networks[J].IEEE Transactions on Network and Service Management,2019,16(1):206-219.
[12] XU X L,DOU W C,ZHANG X Y,et al.EnReal:An Energy-Aware Resource Allocation Method for Scientific Workflow Executions in Cloud Environment[J].IEEE Transactions on Cloud Computing,2016,4(2):166-179.
[13] WU D C,WU Q H,XU Y H,et al.QoE and Energy Aware Resource Allocation in Small Cell Networks With Power Selection,Load Management,and Channel Allocation[J].IEEE Transactions on Vehicular Technology,2017,66(8):7461-7473.
[14] SUN J J,WANG X W,GAO X,et al.Resource AllocationScheme Based on Neural Network and Group Search Optimization in Cloud Environment[J].Journal of Software,2014,25(8):1858-1873.
[15] UTTAM M,PULAK C,MASSIMO T,et al.Bandwidth Provisioning for Virtual Machine Migration in Cloud:Strategy and Application[J].IEEE Transactions on Cloud Computing,2018,6(4):967-976.
[16] JARGALSAIKHAN N,ZHANG H N,HYUK L.Service-A-wareCloud-to-Cloud Migration of Multiple Virtual Machines[J].IEEE Access,2018,6:76663-76672.
[17] TAO F,LI C,LIAO T W,et al.BGM-BLA:A New Algorithm for Dynamic Migration of Virtual Machines in Cloud Computing[J].IEEE Transaction on Services Computing,2016,9(6):910-925.
[18] WU X D,ZENG Y Z,LIN G X.An Energy Efficient VM Migration Algorithm in Data Centers[C]//2017 16th International Symposium on Distributed Computing and Applications to Business,Engineering and Science.2017:27-30.
[19] SURATH L,SOUHEIL K,JAROSLAW F.Virtual Machine Migration Strategy in Cloud Computing[C]//2015 14th International Symposium on Distributed Computing and Applications for Business Engineering and Science.2015:147-150.
[20] ZHANG F,LIU G M,FU X M,et al.A Survey on Virtual Machine Migration:Challenges,Techniques,and Open Issues[J].IEEE Communications Surveys & Tutorials,2018,20(2):1206-1243.
[21] KONSTANTIONS T,VASILIS V,MEMA R,et al.Live VM Migration Under Time-Constraints in Share-Nothing IaaS-Clouds[J].IEEE Transactions on Parallel and Distributed Systems,2017,28(8):2285-2298.
[22] WALTER C,FLAVIO E.Optimizing Live Migration of Multiple Virtual Machines[J].IEEE Transactions on Cloud Computing,2018,6(4):1096-1109.
[23] ZHANG W Z,CHEN Y X,GAO X,et al.Cluster-aware virtual machine collaborative migration in media cloud[J].IEEE Transactions on Parallel and Distributed Systems,2017,28(10):2808-2822.
[24] ZHANG J,REN F Y,SHU R,et al.Guaranteeing Delay of Live Virtual Machine Migration by Determining and Provisioning Appropriate Bandwidth[J].IEEE Transactions on Computers,2016,65(9):2910-2917.
[25] ENZO B,MICHELE S,ALIREZA M.Fog-Supported Delay-Constrained Energy-Saving Live Migration of VMs Over MultiPath TCP/IP 5G Connections[J].IEEE Access,2018,6:42327-42354.
[26] UMESH D,DANNY C,STEVEN C,et al.Scatter-Gather Live Migration of Virtual Machines[J].IEEE Transactions on Cloud Computing,2018,6(1):196-208.
[27] PRADEEP K T,SANDEEP J.Dynamic Weighted Virtual Machine Live Migration Mechanism to Manages Load Balancing in Cloud Computing[C]//2016 IEEE International Conference on Computational Intelligence and Computing Research.2016:1-5.
[28] VEENS R R,SWETHA K,MELODY M.Energy EfficientTraffic-Aware Virtual Machine Migration in Green Cloud Data Centers[C]//2016 IEEE 2nd International Conference on Big Data Security on Cloud.2016:268-273.
[29] HOU C W,HUANG C L,DAI H D,et al.Enabling User-Policy-Confined VM Migration in Trusted Cloud Computing[C]//2016 IEEE 1st International Workshops on Foundations and Applications of Self-Systems.2016:66-71.
[30] SUHIB M M,ANJALI A,NISHITH G,et al.Minimizing Biased VM Selection in Live VM Migration[C]//2017 3rdInternationalConference of Cloud Computing Technologies and Applications (CloudTech).2017:1-7.
[31] OSANAIYE O,CHEN S,YAN Z,et al.From cloud to fog computing:A review and a conceptual live VM migration framework[J].IEEE Access,2017,5:8284-8300.
[32] YANG C,GUO Y,HU H,et al.An effective and scalable VM migration strategy to mitigate cross-VM side-channel attacks in cloud[J].China Communications,2019,16(4):151-171.
[33] JABALIN R P,S S R,JAYAN J P.A Secure Virtual Machine Migration Using Processor Workload Prediction Method for Cloud Environment[C]//2016 International Conference on Circuit,Power and Computing Technologies.2016:1-6.
[34] MEHIAR D,BECHIR H,MOHSEN G,et al.An Energy-Efficient VM Prediction and Migration Framework for Overcommitted Clouds[J].IEEE Transactions on Cloud Computing,2018,6(4):955-966.
[35] MEGHA R D,HIREN B P.Efficient Virtual Machine Migration in Cloud Computing[C]//2015 Fifth International Conference on Communication Systems and Network Technologies.2015:1015-1019.
[36] SONG Y,PHILIPP W,RAMIN Y,et al.Reliable virtual machine placement and routing in clouds[J].IEEE Transactions on Parallel and Distributed Systems,2017,28(10):1-14.
[37] PRAKASH C N,DEEPAK G,ABHISHEK K S,et al.A research paper of existing Live VM Migration and a Hybrid VM Migration approach in Cloud Computing[C]//Proceedings of the 2nd International Conference on Trends in Electronics and Informatics (ICOEI 2018).2018:720-725.
[38] SUHIB B M,ANJALI A,NISHITH G,et al.Selection Process Approaches in Live Migration:A Comparative Study[C]//2017 8th International Conference on Information and Communication Systems (ICICS).2017:23-28.
[39] WANG H,LI Y,ZHANG Y,et al.Virtual machine migration planning in software-defined networks[J].IEEE Transactions on Cloud Computing,2015(99):1-15.
[40] FU X,ZHOU C.Predicted affinity based virtual machine placement in cloud computing environments[J].IEEE Transactions on Cloud Computing,2017(99):1-1.
[41] ANTON B,RAJKUMAR B.OpenStack Neat:a framework for dynamic and energy-efficient consolidation of virtual machines in OpenStack cloud[J].Concurrency and Computation:Practice & Experience,2015,27(5):1310-1333.
[42] ZHENG S P,YU H F,ANAND V,et al.Virtual machine migration techniques managing time-varied workloads[C]//International Conference on Optical Communications & Networks.2014:1-5.

相关文章 15

[1]	刘高聪, 罗永平, 金培权. 基于热点数据的持久性内存索引查询加速 Accelerating Persistent Memory-based Indices Based on Hotspot Data 计算机科学, 2022, 49(8): 26-32. https://doi.org/10.11896/jsjkx.210700176
[2]	史殿习, 赵琛然, 张耀文, 杨绍武, 张拥军. 基于多智能体强化学习的端到端合作的自适应奖励方法 Adaptive Reward Method for End-to-End Cooperation Based on Multi-agent Reinforcement Learning 计算机科学, 2022, 49(8): 247-256. https://doi.org/10.11896/jsjkx.210700100
[3]	陈莹, 郝应光, 王洪玉, 王坤. 基于局部梯度强度图的动态规划检测前跟踪算法 Dynamic Programming Track-Before-Detect Algorithm Based on Local Gradient and Intensity Map 计算机科学, 2022, 49(8): 150-156. https://doi.org/10.11896/jsjkx.210700135
[4]	陈俊, 何庆, 李守玉. 基于自适应反馈调节因子的阿基米德优化算法 Archimedes Optimization Algorithm Based on Adaptive Feedback Adjustment Factor 计算机科学, 2022, 49(8): 237-246. https://doi.org/10.11896/jsjkx.210700150
[5]	王杰, 李晓楠, 李冠宇. 基于自适应注意力机制的知识图谱补全算法 Adaptive Attention-based Knowledge Graph Completion 计算机科学, 2022, 49(7): 204-211. https://doi.org/10.11896/jsjkx.210400129
[6]	唐枫, 冯翔, 虞慧群. 基于自适应知识迁移与资源分配的多任务协同优化算法 Multi-task Cooperative Optimization Algorithm Based on Adaptive Knowledge Transfer andResource Allocation 计算机科学, 2022, 49(7): 254-262. https://doi.org/10.11896/jsjkx.210600184
[7]	谭任深, 徐龙博, 周冰, 荆朝霞, 黄向生. 海上风电场通用运维路径规划模型优化及仿真 Optimization and Simulation of General Operation and Maintenance Path Planning Model for Offshore Wind Farms 计算机科学, 2022, 49(6A): 795-801. https://doi.org/10.11896/jsjkx.210400300
[8]	周天清, 岳亚莉. 超密集物联网络中多任务多步计算卸载算法研究 Multi-Task and Multi-Step Computation Offloading in Ultra-dense IoT Networks 计算机科学, 2022, 49(6): 12-18. https://doi.org/10.11896/jsjkx.211200147
[9]	高越, 傅湘玲, 欧阳天雄, 陈松龄, 闫晨巍. 基于时空自适应图卷积神经网络的脑电信号情绪识别 EEG Emotion Recognition Based on Spatiotemporal Self-Adaptive Graph ConvolutionalNeural Network 计算机科学, 2022, 49(4): 30-36. https://doi.org/10.11896/jsjkx.210900200
[10]	赵亮, 张洁, 陈志奎. 基于双图正则化的自适应多模态鲁棒特征学习 Adaptive Multimodal Robust Feature Learning Based on Dual Graph-regularization 计算机科学, 2022, 49(4): 124-133. https://doi.org/10.11896/jsjkx.210300078
[11]	林利祥, 刘旭东, 刘少腾, 徐跃东. 前向纠错编码在网络传输协议中的应用综述 Survey on the Application of Forward Error Correction Coding in Network Transmission Protocols 计算机科学, 2022, 49(2): 292-303. https://doi.org/10.11896/jsjkx.210500104
[12]	陈乐, 高岭, 任杰, 党鑫, 王祎昊, 曹瑞, 郑杰, 王海. 基于自适应码率移动增强现实应用的能效优化研究 Adaptive Bitrate Streaming for Energy-Efficiency Mobile Augmented Reality 计算机科学, 2022, 49(1): 194-203. https://doi.org/10.11896/jsjkx.201100107
[13]	刘凯, 张宏军, 陈飞琼. 基于领域适应嵌入的军事命名实体识别 Name Entity Recognition for Military Based on Domain Adaptive Embedding 计算机科学, 2022, 49(1): 292-297. https://doi.org/10.11896/jsjkx.201100007
[14]	梁剑, 何军辉. 基于宏块编码信息自适应置换的H.264/AVC视频加密方法 H.264/AVC Video Encryption Based on Adaptive Permutation of Macroblock Coding Information 计算机科学, 2022, 49(1): 314-320. https://doi.org/10.11896/jsjkx.201100089
[15]	赵敏, 刘惊雷. 基于高斯场和自适应图正则的半监督聚类 Semi-supervised Clustering Based on Gaussian Fields and Adaptive Graph Regularization 计算机科学, 2021, 48(7): 137-144. https://doi.org/10.11896/jsjkx.200800190

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed