计算机科学 ›› 2022, Vol. 49 ›› Issue (6A): 639-644.doi: 10.11896/jsjkx.210800071

• 计算机网络 • 上一篇    下一篇

基于服务器集群的负载均衡优化调度算法

田真真1, 蒋维2, 郑炳旭1, 孟利民1   

  1. 1 浙江工业大学信息工程学院 杭州 310000
    2 浙江树人大学信息科技学院 杭州 310000
  • 出版日期:2022-06-10 发布日期:2022-06-08
  • 通讯作者: 孟利民(mlm@zjut.edu.cn)
  • 作者简介:(15264832202@163.com)
  • 基金资助:
    国家自然科学基金(61871349);浙江省自然科学基金(LQ19F010013,LY18F010024);2019年金华市科技计划项目(公益类)(2019-4-176)

Load Balancing Optimization Scheduling Algorithm Based on Server Cluster

TIAN Zhen-zhen1, JIANG Wei2, ZHENG Bing-xu1, MENG Li-min1   

  1. 1 College of Information Engineering,Zhejiang University of Technology,Hangzhou 310000,China
    2 College of Information Science and Technology,Zhejiang Shuren University,Hangzhou 310000,China
  • Online:2022-06-10 Published:2022-06-08
  • About author:TIAN Zhen-zhen,born in 1995,postgraduate.Her main research interests include multimedia communication and so on.
    MENG Li-min,born in 1963,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.Her main research interests include wireless communication and network,streaming media transmission and IoT communication.
  • Supported by:
    National Natural Science Foundation of China (61871349),Natural Science Foundation of Zhejiang Province,China(LQ19F010013,LY18F010024)and Science and Technology Program of Jinhua in 2019(2019-4-176).

摘要: 为了解决服务器集群在处理并发任务请求时请求分配不均衡和任务完成时间较长等问题,提出了一种基于布谷鸟搜索的集群负载均衡多目标优化调度算法。首先,依据服务器集群的任务请求分配特点,通过监控、记录服务器实时负载信息,构建与服务器实时负载信息相关的、以最小化任务完成时间和增强负载均衡有效度为目标函数的优化模型,确定决策变量为任务请求与服务器的匹配集。然后通过引入带精英策略的非支配排序布谷鸟搜索算法对决策变量进行迭代寻优,在适应度函数的选择更新下,找到符合全局最优的Pareto解集,调度机制根据确定最优的匹配集进行任务的调整与转发。仿真结果表明,所提调度算法在保证负载均衡的条件下能够尽可能地缩短任务完成时间,相比其他算法模型,其可扩展性效果更好。

关键词: 并发请求, 布谷鸟搜索算法, 服务器集群, 负载均衡, 请求调度

Abstract: In order to solve the problems of unbalanced request allocation and long task completion time when server clusters process concurrent task requests,a multi-objective optimal scheduling algorithm based on cuckoo search is proposed about server cluster load balancing.Firstly,according to the task request allocation characteristics of the server cluster,an optimization model related to the server real-time load information is constructed,which takes minimizing the task completion time and enhancing the effectiveness of load balancing as the objective function,by monitoring and recording the server real-time load information.And the decision variable is determined as the matching set between the task request and the server.Then,the non-dominated sorting cuckoo search algorithm with elite strategy is introduced to iteratively optimize the decision variables.Under the selection of fitness function,the Pareto solution set conforming to the global optimization is found.And the scheduling mechanism adjusts and forwards the tasks according to the determined optimal matching set.Simulation results show that the proposed scheduling algorithm can not only ensure the balance of server cluster but also reduce the task completion time as much as possible.Compared with other algorithm models,the scalability of the proposed algorithm is better.

Key words: Concurrent request, Cuckoo search algorithm, Load balancing, Request scheduling, Server cluster

中图分类号: 

  • TP301
[1] GUL K S Q,WANG P,LUO S L,et al.A Techenical Research on High-concurrency Web Application[J].Netinfo Security,2017(12):29-35.
[2] BRYHNI H,KLOVNING E,KURE O.A comparison of load balancing techniques for scalable Web servers[J].IEEE Network,2000,14(4):58-64.
[3] ZHOU L,MENG L M,ZHOU L P,et al.Dynamic load balancing algorithm based on bipartite graph maximum matching[J].Chinese High Technology Letters,2020,30(8):798-804.
[4] WEN Z,LI G,YANG G.Research and Realization of Nginx-based Dynamic Feedback Load Balancing Algorithm[C]//Proceedings of the 2018 IEEE 3rd Advanced Information Techno-logy,Electronic and Automation Control Conference(IAEAC).Chongqing,IEEE Press,2018:2541-2546.
[5] WEI X.Research on load balancing of web server cluster based on genetic algorithm [D].Hangzhou:Zhejiang University of Technology,2017.
[6] BAO X A,WEI X,CHEN L,et al.Load balancing method of service cluster based on mean variance[J].Telecommunications Science,2017,33(1):1-8.
[7] ZHANG N,DONG L L,JIN Y T,et al.Web Cluster adaptive load balancing algorithm based on improved cuckoo search[J].Journal of Zhejiang University of Technology(Natural Science Edition),2020,43(4):527-534.
[8] SUN J W,ZHOU L,DING Q L.Research on dynamic load ba-lancing based on annealing algorithm[J].Computer Science,2013,40(5):89-92.
[9] LIU B G,SHU Y A,FU Y H.Software defined network load balancing scheme based on multi-objective optimization[J].Computer Applications,2017,37(6):1555-1559,1573.
[10] TIAN S L,ZUO M,WU S W.An improved load balancing algorithm based on dynamic feedback[J].Computer Engineering and Design,2007,4(3):572-573,728.
[11] SHEN Z X,PENG Y J,YUE X S.Load balancing optimization algorithm for cluster servers under mixed requests[J].Compu-ter Engineering and Applications,2018,54(18):99-104,241.
[12] LI W J,ZHANG Q F,PING L D,et al.Cloud task scheduling algorithm based on fuzzy clustering[J].Journal of Communications,2012,33(3):146-154.
[13] YUAN J B,DING S L,JU J B.Load based task run time prediction model[J].Computer Engineering,2006,4(7):123-125.
[14] ZHANG R L,LI H,YE Z B.Data allocation method based on capability and task completion time[J].Computer Engineering and Design,2018,39(4):923-927.
[15] SU C.Research and application of workshop material distribution path optimization based on improved cuckoo algorithm [D].Anhui:Anhui University,2019.
[16] XU M,ZHOU J,LU Y.An improved clone cuckoo search algorithm for solving the multi-constrained QoS routing problem in self-organizing wireless sensor network[C]//2019 IEEE International Conference of Intelligent Applied Systems on Enginee-ring(ICIASE).Fuzhou,China,2019:32-35.
[17] SONEJI H,SANGHVI R C.Towards the improvement of Cuckoosearch algorithm[C]//2012 World Congress on Information and Communication Technologies.2012:878-883.
[18] LAN S F,LIU S.Review of cuckoo search algorithm[J].Computer Engineering and Design,2015,36(4):1063-1067.
[19] TANG K Z,YANG J Y,GAO S,et al.A linear evolutionary algorithm for constrained multi-objective optimization[J].Computer Science,2009,36(4):235-238.
[20] ZHANG Y J.Research and application of high dimensionalmulti-objective evolutionary algorithm [D].Harbin:Harbin Engineering University,2015.
[21] WU G F.Multi-objective task scheduling scheme based on cuckoosearch algorithm in cloud environment[J].Computer Application Research,2015,32(9):2674-2677.
[22] ZHANG Y W,WANG L,WU Q D.Dynamic adaptive cu-ckoo search algorithm[J].Control and Decision Making,2014,29(4):617-622.
[23] LIAO Y D.Research on load balancing simulation of Web Cluster Based on OPNET [D].Guangxi Normal University,2007.
[1] 高捷, 刘沙, 黄则强, 郑天宇, 刘鑫, 漆锋滨.
基于国产众核处理器的深度神经网络算子加速库优化
Deep Neural Network Operator Acceleration Library Optimization Based on Domestic Many-core Processor
计算机科学, 2022, 49(5): 355-362. https://doi.org/10.11896/jsjkx.210500226
[2] 谭双杰, 林宝军, 刘迎春, 赵帅.
基于机器学习的分布式星载RTs系统负载调度算法
Load Scheduling Algorithm for Distributed On-board RTs System Based on Machine Learning
计算机科学, 2022, 49(2): 336-341. https://doi.org/10.11896/jsjkx.201200126
[3] 夏中, 向敏, 黄春梅.
基于CHBL的P2P视频监控网络分层管理机制
Hierarchical Management Mechanism of P2P Video Surveillance Network Based on CHBL
计算机科学, 2021, 48(9): 278-285. https://doi.org/10.11896/jsjkx.201200056
[4] 宋海宁, 焦健, 刘永.
高速公路中的移动边缘计算研究
Research on Mobile Edge Computing in Expressway
计算机科学, 2021, 48(6A): 383-386. https://doi.org/10.11896/jsjkx.200900212
[5] 王政, 姜春茂.
一种基于三支决策的云任务调度优化算法
Cloud Task Scheduling Algorithm Based on Three-way Decisions
计算机科学, 2021, 48(6A): 420-426. https://doi.org/10.11896/jsjkx.201000023
[6] 郑增乾, 王锟, 赵涛, 蒋维, 孟利民.
带宽和时延受限的流媒体服务器集群负载均衡机制
Load Balancing Mechanism for Bandwidth and Time-delay Constrained Streaming Media Server Cluster
计算机科学, 2021, 48(6): 261-267. https://doi.org/10.11896/jsjkx.200400131
[7] 姚泽玮, 林嘉雯, 胡俊钦, 陈星.
基于PSO-GA的多边缘负载均衡方法
PSO-GA Based Approach to Multi-edge Load Balancing
计算机科学, 2021, 48(11A): 456-463. https://doi.org/10.11896/jsjkx.210100191
[8] 朱汉卿, 马武彬, 周浩浩, 吴亚辉, 黄宏斌.
基于改进多目标进化算法的微服务用户请求分配策略
Microservices User Requests Allocation Strategy Based on Improved Multi-objective Evolutionary Algorithms
计算机科学, 2021, 48(10): 343-350. https://doi.org/10.11896/jsjkx.201100009
[9] 杨紫淇, 蔡英, 张皓晨, 范艳芳.
基于负载均衡的VEC服务器联合计算任务卸载方案
Computational Task Offloading Scheme Based on Load Balance for Cooperative VEC Servers
计算机科学, 2021, 48(1): 81-88. https://doi.org/10.11896/jsjkx.200800220
[10] 郭飞雁, 唐兵.
基于用户延迟感知的移动边缘服务器放置方法
Mobile Edge Server Placement Method Based on User Latency-aware
计算机科学, 2021, 48(1): 103-110. https://doi.org/10.11896/jsjkx.200900146
[11] 王国澎, 杨剑新, 尹飞, 蒋生健.
负载均衡的处理器运算资源分配方法
Computing Resources Allocation with Load Balance in Modern Processor
计算机科学, 2020, 47(8): 41-48. https://doi.org/10.11896/jsjkx.191000148
[12] 金琪, 王俊昌, 付雄.
基于智能放置策略的Cuckoo哈希表
Cuckoo Hash Table Based on Smart Placement Strategy
计算机科学, 2020, 47(8): 80-86. https://doi.org/10.11896/jsjkx.191200109
[13] 曹素娥, 杨泽民.
基于聚类分析算法和优化支持向量机的无线网络流量预测
Prediction of Wireless Network Traffic Based on Clustering Analysis and Optimized Support Vector Machine
计算机科学, 2020, 47(8): 319-322. https://doi.org/10.11896/jsjkx.190800075
[14] 高子妍, 王勇.
面向云服务的分布式消息系统负载均衡策略
Load Balancing Strategy of Distributed Messaging System for Cloud Services
计算机科学, 2020, 47(6A): 318-324. https://doi.org/10.11896/JsJkx.191100012
[15] 黄梅根, 汪涛, 刘亮, 庞瑞琴, 杜欢.
基于软件定义网络资源优化的虚拟网络功能部署策略
Virtual Network Function Deployment Strategy Based on Software Defined Network Resource Optimization
计算机科学, 2020, 47(6A): 404-408. https://doi.org/10.11896/JsJkx.191000116
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!