基于多属性最优化的海洋监测数据副本布局策略

doi:10.11896/j.issn.1002-137X.2018.06.012

计算机科学 ›› 2018, Vol. 45 ›› Issue (6): 72-75.doi: 10.11896/j.issn.1002-137X.2018.06.012

• 第十四届全国Web信息系统及其应用学术会议 • 上一篇下一篇

基于多属性最优化的海洋监测数据副本布局策略

黄冬梅¹, 杜艳玲^1,2, 贺琪¹, 随宏运¹, 李瑶¹

上海海洋大学信息学院上海201306¹;
国家海洋局东海预报中心上海200136²

收稿日期:2017-03-11 出版日期:2018-06-15 发布日期:2018-07-24
作者简介:黄冬梅(1964－),女,教授,博士生导师,主要研究方向为云存储、分布式计算、海洋数据管理以及辅助决策系统,E-mail:dmhuang@shou.edu.cn;杜艳玲(1987－),女,博士,主要研究方向为海洋大数据存储、数据迁移,E-mail:DYanLing2010@gmail.com;贺琪(1979－),女,博士,副教授,主要研究方向为大数据布局、云计算、服务计算、业务流程管理,E-mail:qihe@shou.edu.cn(通信作者);随宏运(1991－),硕士,主要研究方向为大数据布局、海洋数据管理,E-mail:suisuishy@163.com;李瑶(1992－),女,硕士生,主要研究方向为深度学习、数据管理,E-mail:liyaojc2@163.com
基金资助:
本文受国家自然科学基金(41671431),国家重点研发计划(2016YFC1401907),上海市科委能力建设项目(15590501900)资助

Marine Monitoring Data Replica Layout Strategy Based on Multiple Attribute Optimization

HUANG Dong-mei¹, DU Yan-ling^1,2, HE Qi¹, SUI Hong-yun¹, LI Yao¹

College of Information Technology,Shanghai Ocean University,Shanghai 201306,China¹;
East China Sea Marine Forecast Center of State Oceanic Administration,Shanghai 200136,China²

Received:2017-03-11 Online:2018-06-15 Published:2018-07-24

摘要/Abstract

摘要： 数据的完整性和可靠性是保证其能被高效访问的关键,尤其是在云存储环境中,数据副本策略是影响系统性能和保障数据可用性的核心。从数据副本布局的角度,提出了基于多属性最优化的数据副本布局策略(Data Replica Layout Strategy based on Multiple Attribute Optimization,MAO-DRLS)。该策略根据数据的访问热度和存储节点的关键属性特点,为每个数据设置动态的副本数,并选择合适的节点对副本进行布局。实验表明,MAO-DRLS策略能够有效地提升数据副本的利用率,缩短系统的响应时间。

关键词: 多属性最优化, 海洋监测数据, 数据布局, 数据副本

Abstract: The integrity and reliability of data are the key to ensure its efficient access.Especially in the cloud storage environment,data replication strategy is the core of the system performance and the availability of data.For a data replica layout,this paper put forward a data replica layout strategy based on multiple attribute optimization (MAO-DRLS).According to the heat of data access and the key attributes of storage node,it sets the number of replicas for each dynamic data,and chooses the appropriate node to distribute the replicas.The experiments show that the MAO-DRLS strategy can effectively improve theutilization rate of data replicas and shorten the system response time.

Key words: Data layout, Data replica, Marine monitoring data, Multiple attribute optimization

中图分类号:

TP311.13

黄冬梅, 杜艳玲, 贺琪, 随宏运, 李瑶. 基于多属性最优化的海洋监测数据副本布局策略[J]. 计算机科学, 2018, 45(6): 72-75. https://doi.org/10.11896/j.issn.1002-137X.2018.06.012

HUANG Dong-mei, DU Yan-ling, HE Qi, SUI Hong-yun, LI Yao. Marine Monitoring Data Replica Layout Strategy Based on Multiple Attribute Optimization[J]. Computer Science, 2018, 45(6): 72-75. https://doi.org/10.11896/j.issn.1002-137X.2018.06.012

参考文献

[1]ZHANG Y,CHEN C,FENG D G.Fine-Grained mandatory query access control model and its efficient realization for spatial vector data[J].Journal of Software,2011,22(8):1872-1883. (in Chinese)
张妍,陈驰,冯登国.空间矢量数据细粒度强制查询访问控制模型及其高效实现[J].软件学报,2011,22(8):1872-1883.
[2]ZHANG K.Study of ocean visualization parallel computing framework based on GPU-Hadoop[D].Qingdao:Ocean University of China,2014.(in Chinese)
张凯.基于GPU-hadoop的海洋环境信息可视化并行计算框架研究与实现[D].青岛:中国海洋大学,2014.
[3]STATECZNY A,WLODARCZYK-SIELICKA M.Self-organizing artificial neural networks into hydrographic big data reduction process[C]//International Conference on Rough Sets and Intelligent Systems Paradigms.Springer International Publishing,2014:335-342.
[4]LIU D J,LIU G H,LIU Z Q,et al.On modeling and querying of text corpora[J].Journal of Chinese Computer Systems,2015,36(8):1711-1716.(in Chinese)
刘鼎甲,刘国华,刘泽权,等.面向文本语料库的数据模型及其查询问题[J].小型微型计算机系统,2015,36(8):1711-1716.
[5]FARRINGTON J W.Oil pollution in the marine environment I:inputs,big spills,small spills,and dribbles[J].Environment:Scien-ce and Policy for Sustainable Development,2013,55(6):3-13.
[6]TAN S,JIA Y,HAN W H.Research and Development of Provable Data Integrity in Cloud Storage[J].Chinese Journal of Computers,2015,38(1):164-177.(in Chinese)
谭霜,贾焰,韩伟红.云存储中的数据完整性证明研究及进展[J].计算机学报,2015,38(1):164-177.
[7]LIU X,SAYDAH B,ERANKI P,et al.Pilot-scale data provide enhanced estimates of the life cycle energy and emissions profile of algae biofuels produced via hydrothermal liquefaction[J].Bioresource Technology,2013,148(8):163-171.
[8]DEYLAMSALEHI A,AFSHARLAR P,VOKKARANE V M.Real-time energy price-aware any cast RWA in optical data center networks[C]//2016 International Conference on Computing,Networking and Communications (ICNC).IEEE,2016:1-6.
[9]LONG S Q,ZHAO Y L,CHEN W.MORM:A Multi-objective Optimized Replication Management strategy for cloud storage cluster[J].Journal of Systems Architecture,2014,60(2):234-244.
[10]MAO B,WU S,JIANG H.Improving storage availability in cloud-of-clouds with hybrid redundant data distribution[C]//IEEE International Parallel and Distributed Processing Sympo-sium (IPDPS).IEEE,2015:633-642.
[11]MANSOUR L,MOUSSAOUI S.RDAP:Requested data accessibility protocol for vehicular sensor networks[C]//International Conference on Smart Communications in Network Technologies (SaCoNeT). IEEE,2013:1-5.
[12]TU M,MA H,XIAO L,et al.Data placement in P2P data grids considering the availability,security,access performance and load balancing[J].Journal of Grid Computing,2013,11(1):103-127.
[13]GUAN C,LUH P B,MICHEL L D,et al.Very short-term load forecasting:wavelet neural networks with data pre-filtering[J].IEEE Transactions on Power Systems,2013,28(1):30-41.
[14]VINES T H,ALBERT A Y K,ANDREW R L,et al.The availability of research data declines rapidly with article age[J].Current biology,2014,24(1):94-97.
[15]XU J,KONG M,LIN A,et al.OFDM-based broadband underwater wireless optical communication system using a compact blue LED[J].Optics Communications,2016,369:100-105.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

基于多属性最优化的海洋监测数据副本布局策略

Marine Monitoring Data Replica Layout Strategy Based on Multiple Attribute Optimization

PDF (PC)

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 5

Metrics

本文评价

推荐阅读 0

[1]	刘漳辉, 赵旭, 林兵, 陈星. 混合云环境下基于模糊理论的科学工作流数据布局策略 Data Placement Strategy of Scientific Workflow Based on Fuzzy Theory in Hybrid Cloud 计算机科学, 2021, 48(11): 199-207. https://doi.org/10.11896/jsjkx.200900009
[2]	黄引豪, 马郓, 林兵, 於志勇, 陈星. 混合云环境下面向代价优化的工作流数据布局方法 Cost-driven Workflow Data Placement Method in Hybrid Cloud Environment 计算机科学, 2019, 46(11A): 354-358.
[3]	缪嘉嘉,付印金,毛捍东. KingCloud:智能对象归档系统 KingCloud:Object Oriented Archiving System 计算机科学, 2016, 43(Z11): 575-577. https://doi.org/10.11896/j.issn.1002-137X.2016.11A.130
[4]	. 采用动态投票机制的数据网格副本一致性维护计算机科学, 2009, 36(4): 172-174.
[5]	杨敏王刚刘璟陈北莲. 用双目标加权遗传算法解决网络磁盘阵列系统下校验散布布局优化问题的研究计算机科学, 2005, 32(5): 73-75.