计算机科学 ›› 2018, Vol. 45 ›› Issue (6): 72-75.doi: 10.11896/j.issn.1002-137X.2018.06.012

• 第十四届全国Web信息系统及其应用学术会议 • 上一篇    下一篇

基于多属性最优化的海洋监测数据副本布局策略

黄冬梅1, 杜艳玲1,2, 贺琪1, 随宏运1, 李瑶1   

  1. 上海海洋大学信息学院 上海2013061;
    国家海洋局东海预报中心 上海2001362
  • 收稿日期:2017-03-11 出版日期:2018-06-15 发布日期:2018-07-24
  • 作者简介:黄冬梅(1964-),女,教授,博士生导师,主要研究方向为云存储、分布式计算、海洋数据管理以及辅助决策系统,E-mail:dmhuang@shou.edu.cn;杜艳玲(1987-),女,博士,主要研究方向为海洋大数据存储、数据迁移,E-mail:DYanLing2010@gmail.com;贺 琪(1979-),女,博士,副教授,主要研究方向为大数据布局、云计算、服务计算、业务流程管理,E-mail:qihe@shou.edu.cn(通信作者);随宏运(1991-),硕士,主要研究方向为大数据布局、海洋数据管理,E-mail:suisuishy@163.com;李 瑶(1992-),女,硕士生,主要研究方向为深度学习、数据管理,E-mail:liyaojc2@163.com
  • 基金资助:
    本文受国家自然科学基金(41671431),国家重点研发计划(2016YFC1401907),上海市科委能力建设项目(15590501900)资助

Marine Monitoring Data Replica Layout Strategy Based on Multiple Attribute Optimization

HUANG Dong-mei1, DU Yan-ling1,2, HE Qi1, SUI Hong-yun1, LI Yao1   

  1. College of Information Technology,Shanghai Ocean University,Shanghai 201306,China1;
    East China Sea Marine Forecast Center of State Oceanic Administration,Shanghai 200136,China2
  • Received:2017-03-11 Online:2018-06-15 Published:2018-07-24

摘要: 数据的完整性和可靠性是保证其能被高效访问的关键,尤其是在云存储环境中,数据副本策略是影响系统性能和保障数据可用性的核心。从数据副本布局的角度,提出了基于多属性最优化的数据副本布局策略(Data Replica Layout Strategy based on Multiple Attribute Optimization,MAO-DRLS)。该策略根据数据的访问热度和存储节点的关键属性特点,为每个数据设置动态的副本数,并选择合适的节点对副本进行布局。实验表明,MAO-DRLS策略能够有效地提升数据副本的利用率,缩短系统的响应时间。

关键词: 海洋监测数据, 数据副本, 多属性最优化, 数据布局

Abstract: The integrity and reliability of data are the key to ensure its efficient access.Especially in the cloud storage environment,data replication strategy is the core of the system performance and the availability of data.For a data replica layout,this paper put forward a data replica layout strategy based on multiple attribute optimization (MAO-DRLS).According to the heat of data access and the key attributes of storage node,it sets the number of replicas for each dynamic data,and chooses the appropriate node to distribute the replicas.The experiments show that the MAO-DRLS strategy can effectively improve theutilization rate of data replicas and shorten the system response time.

Key words: Marine monitoring data, Data replica, Multiple attribute optimization, Data layout

中图分类号: 

  • TP311.13
[1]ZHANG Y,CHEN C,FENG D G.Fine-Grained mandatory query access control model and its efficient realization for spatial vector data[J].Journal of Software,2011,22(8):1872-1883. (in Chinese)
张妍,陈驰,冯登国.空间矢量数据细粒度强制查询访问控制模型及其高效实现[J].软件学报,2011,22(8):1872-1883.
[2]ZHANG K.Study of ocean visualization parallel computing framework based on GPU-Hadoop[D].Qingdao:Ocean University of China,2014.(in Chinese)
张凯.基于GPU-hadoop的海洋环境信息可视化并行计算框架研究与实现[D].青岛:中国海洋大学,2014.
[3]STATECZNY A,WLODARCZYK-SIELICKA M.Self-organizing artificial neural networks into hydrographic big data reduction process[C]//International Conference on Rough Sets and Intelligent Systems Paradigms.Springer International Publishing,2014:335-342.
[4]LIU D J,LIU G H,LIU Z Q,et al.On modeling and querying of text corpora[J].Journal of Chinese Computer Systems,2015,36(8):1711-1716.(in Chinese)
刘鼎甲,刘国华,刘泽权,等.面向文本语料库的数据模型及其查询问题[J].小型微型计算机系统,2015,36(8):1711-1716.
[5]FARRINGTON J W.Oil pollution in the marine environment I:inputs,big spills,small spills,and dribbles[J].Environment:Scien-ce and Policy for Sustainable Development,2013,55(6):3-13.
[6]TAN S,JIA Y,HAN W H.Research and Development of Provable Data Integrity in Cloud Storage[J].Chinese Journal of Computers,2015,38(1):164-177.(in Chinese)
谭霜,贾焰,韩伟红.云存储中的数据完整性证明研究及进展[J].计算机学报,2015,38(1):164-177.
[7]LIU X,SAYDAH B,ERANKI P,et al.Pilot-scale data provide enhanced estimates of the life cycle energy and emissions profile of algae biofuels produced via hydrothermal liquefaction[J].Bioresource Technology,2013,148(8):163-171.
[8]DEYLAMSALEHI A,AFSHARLAR P,VOKKARANE V M.Real-time energy price-aware any cast RWA in optical data center networks[C]//2016 International Conference on Computing,Networking and Communications (ICNC).IEEE,2016:1-6.
[9]LONG S Q,ZHAO Y L,CHEN W.MORM:A Multi-objective Optimized Replication Management strategy for cloud storage cluster[J].Journal of Systems Architecture,2014,60(2):234-244.
[10]MAO B,WU S,JIANG H.Improving storage availability in cloud-of-clouds with hybrid redundant data distribution[C]//IEEE International Parallel and Distributed Processing Sympo-sium (IPDPS).IEEE,2015:633-642.
[11]MANSOUR L,MOUSSAOUI S.RDAP:Requested data accessibility protocol for vehicular sensor networks[C]//International Conference on Smart Communications in Network Technologies (SaCoNeT). IEEE,2013:1-5.
[12]TU M,MA H,XIAO L,et al.Data placement in P2P data grids considering the availability,security,access performance and load balancing[J].Journal of Grid Computing,2013,11(1):103-127.
[13]GUAN C,LUH P B,MICHEL L D,et al.Very short-term load forecasting:wavelet neural networks with data pre-filtering[J].IEEE Transactions on Power Systems,2013,28(1):30-41.
[14]VINES T H,ALBERT A Y K,ANDREW R L,et al.The availability of research data declines rapidly with article age[J].Current biology,2014,24(1):94-97.
[15]XU J,KONG M,LIN A,et al.OFDM-based broadband underwater wireless optical communication system using a compact blue LED[J].Optics Communications,2016,369:100-105.
[1] 黄引豪, 马郓, 林兵, 於志勇, 陈星. 混合云环境下面向代价优化的工作流数据布局方法[J]. 计算机科学, 2019, 46(11A): 354-358.
[2] 缪嘉嘉,付印金,毛捍东. KingCloud:智能对象归档系统[J]. 计算机科学, 2016, 43(Z11): 575-577.
[3] . 采用动态投票机制的数据网格副本一致性维护[J]. 计算机科学, 2009, 36(4): 172-174.
[4] 杨敏 王刚 刘璟 陈北莲. 用双目标加权遗传算法解决网络磁盘阵列系统下校验散布布局优化问题的研究[J]. 计算机科学, 2005, 32(5): 73-75.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] 编辑部. 新网站开通,欢迎大家订阅![J]. 计算机科学, 2018, 1(1): 1 .
[2] 雷丽晖,王静. 可能性测度下的LTL模型检测并行化研究[J]. 计算机科学, 2018, 45(4): 71 -75 .
[3] 孙启,金燕,何琨,徐凌轩. 用于求解混合车辆路径问题的混合进化算法[J]. 计算机科学, 2018, 45(4): 76 -82 .
[4] 张佳男,肖鸣宇. 带权混合支配问题的近似算法研究[J]. 计算机科学, 2018, 45(4): 83 -88 .
[5] 伍建辉,黄中祥,李武,吴健辉,彭鑫,张生. 城市道路建设时序决策的鲁棒优化[J]. 计算机科学, 2018, 45(4): 89 -93 .
[6] 史雯隽,武继刚,罗裕春. 针对移动云计算任务迁移的快速高效调度算法[J]. 计算机科学, 2018, 45(4): 94 -99 .
[7] 周燕萍,业巧林. 基于L1-范数距离的最小二乘对支持向量机[J]. 计算机科学, 2018, 45(4): 100 -105 .
[8] 刘博艺,唐湘滟,程杰仁. 基于多生长时期模板匹配的玉米螟识别方法[J]. 计算机科学, 2018, 45(4): 106 -111 .
[9] 耿海军,施新刚,王之梁,尹霞,尹少平. 基于有向无环图的互联网域内节能路由算法[J]. 计算机科学, 2018, 45(4): 112 -116 .
[10] 崔琼,李建华,王宏,南明莉. 基于节点修复的网络化指挥信息系统弹性分析模型[J]. 计算机科学, 2018, 45(4): 117 -121 .