计算机科学 ›› 2018, Vol. 45 ›› Issue (7): 66-72.doi: 10.11896/j.issn.1002-137X.2018.07.010

• 第三十三届全国信息存储技术学术会议 • 上一篇    下一篇

一种基于新能源驱动的存储系统的能耗优化方案

庄晓照,万继光,张艺文,瞿晓阳   

  1. 华中科技大学武汉光电国家实验室筹 武汉430074
  • 收稿日期:2017-07-16 出版日期:2018-07-30 发布日期:2018-07-30
  • 作者简介:庄晓照(1992-),男,硕士生,主要研究方向为分布式存储;万继光(1972-),男,博士,教授,主要研究方向为存储系统、人工智能,E-mail:jgwan@hust.edu.cn(通信作者);张艺文(1996-),男,博士生,主要研究方向为基于新型存储介质的键值存储系统;瞿晓阳(1988-),男,博士,主要研究方向为分布式与存储、大数据、面向AI的云平台。

Energy Consumption Optimization Scheme for New Energy-driven Storage System

ZHUANG Xiao-zhao,WAN Ji-guang,ZHANG Yi-wen,QU Xiao-yang   

  1. Wuhan National Laboratory for Optoelectronics,Huazhong University of Science and Technology,Wuhan 430074,China
  • Received:2017-07-16 Online:2018-07-30 Published:2018-07-30

摘要: 能源成本的增长和环境问题的日益突出使得数据中心面临严峻挑战,引进经济环保的新能源已经迫在眉睫。但是,新能源的间歇性、不稳定性和突变性等特点,导致数据中心无法有效适应新能源。为此,各大数据中心提出能源管理策略和负载调度算法等解决方案,但是现有的研究成果大多是针对计算方面的能耗优化,无法适应于存储方面。鉴于此,提出一种基于新能源驱动的存储系统的能耗优化方案,利用不同存储介质的特性和在线-离线负载划分模型来实现负载能耗需求和新能源供应的匹配。为保证存储系统的性能和能耗效率,采用双驱动和虚拟化合并技术实现细粒度的能耗控制方案;此外,还设计并实现了一种离线负载优化调度算法,进一步提高了新能源的利用率。实验结果表明,优化能耗方案可以使新能源的利用率达到95%,同时保证存储系统性能的退化比例低于9.8%。

关键词: 负载调度, 能耗优化, 新能源驱动, 虚拟化合并, 异构存储系统

Abstract: The growth of energy costs and the increasing environmental problems make the data center face severe challenges,and the introduction of economic environment-friendly new energy is imminent.But the new energy has several cha-racteristics such as intermittent,unstable and mutagenic,causing the data center can not effectively adapt new energy.To this end,the major data centers put forward many solutions,such as energy management strategies and load scheduling algorithms,etc.However,most of the existing research results emphasize the optimization of the calculation of energy consumption,and it can not be further adapted to storage.Therefore,this paper presented an energy consumption optimization scheme for new energy-driven storage system,and used the characteristics of different storage media and online-offline workload classification model to implement the matching between workload energy comsumption requirement and new energy supplying.In order to guarantee the performance and improve the energy efficiency of the storage system,the dual-drive energy control method and the virtualization consolidation technology were used to achieve fine-grained energy control program.In addition,this paper also designed and implemented an offline-workload scheduling algorithm to further improve the utilization of new energy.The experimental results show that the optimization scheme for new energy-driven storage system can make the utilization rate of new energy reach 95%,while ensuring the degradation rate of the storage system is less than 9.8%.

Key words: Energy optimization, Heterogeneous storage systems, New energy-driven, Virtualization consolidation, Workload scheduling

中图分类号: 

  • D520
[1]KOOMEY J.Growth in Data Center Electricity Use 2005 to2010[R].Analytics Press,2005.
[2]DENG W,LIU F M,JIN H,et al.Leveraging Renewable Energy in Cloud Computing Datacenters:State of the Art and Future Research[J].Chinese Journal of Computers,2013,36(3):582-598.(in Chinese)
邓维,刘方明,金海,等.云计算数据中心的新能源应用:研究现状与趋势.计算机学报,2013,36(3):582-598.
[3]MANKOFF J,KRAVETS R,BLEVIS E.Some Computer Scien-ce Issues in Creating a Sustainable World[J].COMPUTER-LOS ALAMITOS-,2008,41(8):102-105.
[4]SHIBATA T,KURACHI Y.Big data analysis solutions for dri-ving innovation in on-site decision making[J].Fujitsu Science Technology Journal,2015,51(2):33-41.
[5]LV T W.The depth analysis and prospect for depth analysis and prospect.The World of Power Supply,2012(12):6-8.(in Chinese)
吕天文.中国绿色数据中心深度解析与展望.电源世界,2012(12):6-8.
[6]QU X,WAN J,WANG J,et al.GreenMatch:Renewable-Aware Workload Scheduling for Massive Storage Systems∥Parallel and Distributed Processing Symposium,2016 IEEE International. IEEE, 2016:403-412.
[7]YUAN J L,ZHONG L,YANG G,et al.Towards Filling and Classification of Incomplete Energy Big Data for Green Data Centers [J].Chinese Journal of Computers,2015,38(12):2499-2516.(in Chinese)
袁景凌,钟珞,杨光,等.绿色数据中心不完备能耗大数据填补及分类算法研究[J].计算机学报,2015,38(12):2499-2516.
[8]KRIOUKOV A,ALSPAUGH S,MOHAN P,et al.Design andevaluation of an energy agile computing cluster:Tech.Rep.UCB/EECS-2012-13[R].EECS Department,University of California,Berkeley,2012.
[9]ZHOU X,CAI H,CAO Q,et al.Greengear:leveraging and managing server heterogeneity for improving energy efficiency in green data centers[C]∥Proceedings of the 2016 International Conference on Supercomputing.ACM,2016:12.
[10]LI C,QOUNEH A,LI T.iSwitch:coordinating and optimizingrenewable energy powered server clusters[C]∥2012 39th Annual International Symposium on Computer Architecture (ISCA).IEEE,2012:512-523.
[11]AHMAD F,VIJAYKUMAR T N.Joint optimization of idle and cooling power in data centers while maintaining response time[J].Acm Sigarch Computer Architecture News,2010,45(3):243-256.
[12]MOORE J,CHASE J S,RANGANATHAN P.Weatherman:Automated,Online and Predictive Thermal Mapping and Ma-nagement for Data Centers[C]∥IEEE,2006.
[13]MOORE J,CHASE J,RANGANATHAN P,et al.MakingScheduling “Cool”:Temperature-Aware Workload Placement in Data Centers[C]∥Conference on Usenix Technical Conference.2005:61-75.
[14]IGO G,LE K,HAQUE M E,et al.GreenSlot:scheduling energy consumption in green datacenters[C]∥International Conference for High PERFORMANCE Computing,Networking,Storage and Analysis.IEEE Computer Society,2011:1-11.
[15]LE K,NGUYEN T D,GUITART J,et al.GreenHadoop:leveraging green energy in data-processing frameworks[C]∥ACM European Conference on Computer Systems.ACM,2012:57-70.
[16]THERESKA E,DONNELLY A,NARAYANAN D.Sierra:practical power-proportionality for data center storage∥European Conference on Computer Systems,Proceedings of the Sixth European Conference on Computer Systems(EUROSYS 2011).Alzburg,Austria-April.DBLP,2011:169-182.
[17]AMUR H,CIPAR J,GUPTA V,et al.Robust and flexible po-wer-proportional storage[C]∥ACM Symposium on Cloud Computing.ACM,2010:217-228.
[18]LEE H J,LEE K H,NOH S H.Augmenting RAID with an SSD for energy relief[C]∥Proceedings of the 2008 conference on Power aware computing and systems.USENIX Association,2008:12.
[19]PRITCHETT T,THOTTETHODI M.SieveStore:a highly-se-lective,ensemble-level disk cache for cost-performance[C]∥ACM SIGARCH Computer Architecture News.ACM,2010:163-174.
[1] 金小敏, 滑文强.
移动云计算中面向能耗优化的资源管理
Energy Optimization Oriented Resource Management in Mobile Cloud Computing
计算机科学, 2020, 47(6): 247-251. https://doi.org/10.11896/jsjkx.190400020
[2] 胡锦天, 王高才, 徐晓桐.
移动边缘计算中具有能耗优化的任务迁移策略
Task Migration Strategy with Energy Optimization in Mobile Edge Computing
计算机科学, 2020, 47(6): 260-265. https://doi.org/10.11896/jsjkx.190400074
[3] 张彭奕, 宋杰.
区块链共识算法效能优化研究进展
Research Advance on Efficiency Optimization of Blockchain Consensus Algorithms
计算机科学, 2020, 47(12): 296-303. https://doi.org/10.11896/jsjkx.200700020
[4] 卢海峰, 顾春华, 罗飞, 丁炜超, 袁野, 任强.
强化学习下能耗优化的虚拟机放置策略
Virtual Machine Placement Strategy with Energy Consumption Optimization under Reinforcement Learning
计算机科学, 2019, 46(9): 291-297. https://doi.org/10.11896/j.issn.1002-137X.2019.09.044
[5] 黄荣喜, 王淖, 谢天骁, 王高才.
无线网络中具有信道感知的期望能耗最小化策略研究
Study on Channel-aware Expected Energy Consumption Minimization Strategy in Wireless Networks
计算机科学, 2018, 45(10): 130-137. https://doi.org/10.11896/j.issn.1002-137X.2018.10.025
[6] 许慧青,王高才,闵仁江.
一种基于协同缓存的内容中心网络能耗优化策略
Energy-consumption Optimization Strategy Based on Cooperative Caching for Content-centric Network
计算机科学, 2017, 44(8): 76-81. https://doi.org/10.11896/j.issn.1002-137X.2017.08.014
[7] 廖彬,张陶,于炯,国冰磊,刘炎.
基于Spark的MapReduce相似度计算效率优化
Efficiency Optimization Method for MapReduce Similarity Computing Based on Spark
计算机科学, 2017, 44(8): 46-53. https://doi.org/10.11896/j.issn.1002-137X.2017.08.009
[8] 彭颖,王高才,王淖.
移动网络中基于数据到达速率的数据传输能耗优化策略
Energy Consumption Optimization Strategy for Data Transmission Based on Data Arrival Rate in Mobile Networks
计算机科学, 2017, 44(1): 117-122. https://doi.org/10.11896/j.issn.1002-137X.2017.01.023
[9] 王科特,王力生,廖新考.
基于多核处理器的K线程低能耗的任务调度优化算法
K-threaded Low Energy-consuming Task Scheduling Optimization Algorithm Based on Multi-core Processors
计算机科学, 2015, 42(2): 18-23. https://doi.org/10.11896/j.issn.1002-137X.2015.02.004
[10] 国冰磊,于 炯,廖 彬,杨德先.
SQL能耗建模及优化研究
Research on SQL Energy Consumption Modeling and Optimization
计算机科学, 2015, 42(10): 202-207.
[11] 肖志娇,明仲,蔡树彬.
基于状态管理的服务器节能策略研究
Study on Energy Optimization of Servers Based on States Management
计算机科学, 2013, 40(4): 22-25.
[12] 俞莉花,曾国荪.
异构计算中的时间和能耗优化执行方法
Executing Method of Time and Energy Optimization in Heterogeneous Computing
计算机科学, 2011, 38(10): 285-290.
[13] 成鹭,成庚民.
无线传感网络中基于综合因素的分布式路由算法
Distributed Weight-clustering Algorithm in Wireless Sensor Networks
计算机科学, 2009, 36(9): 59-62.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!