计算机科学 ›› 2013, Vol. 40 ›› Issue (9): 25-29.

• 综述 • 上一篇    下一篇

领域科学数据云资源聚合模型

葛敬军,胡长军,刘歆,李扬,刘振宇   

  1. 北京科技大学计算机与通信工程学院 北京100083;北京科技大学计算机与通信工程学院 北京100083;北京科技大学计算机与通信工程学院 北京100083;北京科技大学计算机与通信工程学院 北京100083;北京科技大学计算机与通信工程学院 北京100083
  • 出版日期:2018-11-16 发布日期:2018-11-16
  • 基金资助:
    本文受国家重点基础研究发展规划“973”项目(2013CB329605),十二五国家科技支撑计划课题(2011BAK08B04)资助

Resources Aggregation Model towards Domain-specific Scientific Data Cloud

GE Jing-jun,HU Chang-jun,LIU Xin,LI Yang and LIU Zhen-yu   

  • Online:2018-11-16 Published:2018-11-16

摘要: 数据中心作为领域科学数据资源的核心设施,正在变得过于复杂、昂贵和低效。大规模领域应用和用户数量的增长,给数据中心的连接性、稳定性和安全性带来严峻的挑战。关于数据中心的资源整合、自动部署以及资源集中化管理正在受到当前学术界和企业界的广泛关注。以实现领域数据中心资源聚合、共享以及统一管理为目的,通过构建领域科学数据云,将多个数据中心连接成一种虚拟的数据网络,以便为领域数据访问、数据集成和数据管理提供环境和服务支持。着重研究了数据云代理模型、异构源共享模型以及资源消息模型。这些模型对于提高数据中心可扩展性和容错性、降低数据中心资源整合成本以及实现从传统数据中心向云化数据中心过渡起到非常关键的作用。最后,将领域科学数据云资源聚合模型引入到油气井科研数据共享服务平台的开发、部署、运行及监控管理中。实践表明,领域科学数据云模型是切实可行的,对于推动领域数据集成、共享、管理研究具有重要的参考意义和应用价值。

关键词: 领域科学数据云,数据共享,资源聚合,虚拟化 中图法分类号TP311文献标识码A

Abstract: Data center as the core facilities of the scientific data resources,is becoming overly complex,expensive and inefficient.Along with the large scale application and the increase number of the users,the connectivity,stability and safety of the data center become a serious challenge.Researches on resource integration,automatic deployment and resources centralization management in data center,are concerned by the current academic and business fields.This paper constructed domain-specific scientific data cloud to connect multiple decentralized and self-organizing data center into a virtual data network.It provides environment and service support for scientific data access,data integration,data sharing and data management,in order to realize data resources gathered,the large-scale scientific data sharing and unified mana-gement.And on this basis,this paper studied the data center agent model,heterogeneous source sharing model and resources communication model emphatically.Study of these models plays a critical roles to improve the data center scala-bility and fault tolerance,to reduce the data center operation and maintenance cost,and to realize the transition from the traditional data center to cloud data center.Finally,this paper introduced the resources aggregation model towards domain-specific scientific data cloud into the development,deployment,operation and monitoring management of the oil and gas well scientific data sharing service platform.The practice demonstrats that the open scientific data cloud model technology is feasible,and has an important reference significance and application value to promote scientific data integration,sharing,and management research.

Key words: Scientific data cloud,Data sharing,Resource integration,Virtualization

[1] 王意洁,孙伟东,周松,等.云计算环境下的分布存储关键技术[J].软件学报,2012,3(4):962-986
[2] Gray J.Rethinking data center network connectivity for new architectures [EB/OL].http://www.searchnetworking.techtarget.com/news/2240036484/Rethinking-data-center-network-conn-ectivity-for-new-architectures,2012-08-06
[3] 从孤岛到融合:数据中心网络架构的革命[EB/OL].http://net.chinaunix.net/a2011/0920/1248/000001248682_2.shtml,2012-08-06
[4] 新蓝图:云计算和数据中心融合[EB/OL].http://www.ciotimes.com/infrastructure/sjk/61535.html,2012-10-06
[5] Meng X,et al.Improving the scalability of data center networks with traffic-aware virtual machine placement[C]∥Proc IN-FOCOM.2010:1154-1162
[6] Greenberg A,Hamilton J R,Jain N,et al.VL2:A scalable and flexible data center network[C]∥Proc.of the SIGCOMM 2009.2009:51-62
[7] 数据中心:融合基础架构[EB/OL].http://www.d1net.com/datacenter/tech/78307.html,2012-08-06
[8] Li B,et al.EnaCloud:an energy-saving application live placement approach for cloud compu-ting environments[C]∥Proc of International Conf on Cloud Computing.2009:17-24
[9] Valancius V,Laoutaris N,et al.Greening the Internet with nano data centers[C]∥Proc of CoNext.2009:37-48
[10] 张伟,宋莹,阮利,等.面向 Internet 数据中心的资源管理[J].软件学报,2012,3(2):179-198
[11] Chang F,Dean J,Ghemawat S,et al.Bigtable:A distributedstorage system for structured data [C]∥Proc.of the 7th USENIX Symp.on Operating.Systems Design and Implementation.Berkeley:USENIX Association,2006:205-218
[12] Chaganti P.Cloud computing with Amazon Web Services.Part 5:Dataset processing in the cloud with SimpleDB.http://www.ibm.com/developerworks/library/ar-cloudaws5/,2009
[13] A brief overview of the Cassandra storage engine [EB/OL].http://cassandra.apache.org/,2012-10-05
[14] Waldspurger C A.Memory resource management in VMwareESX server[C]∥Proceedings of the 5th Symposium on Opera-ting Systems Design and Implementation(OSDI2002),ACM O-perating Systems Review,Winter 2002Special Issue.Boston,MA,USA,Dec.2002:181-194
[15] Velte A,Velte T.Microsoft Virtualization with Hyper-V[M].McGraw-Hill Inc.New York,NY,2009
[16] 钱琼芬,李春林,张小庆,等.云数据中心虚拟资源管理研究综述[J].计算机应用研究,2012,9(07):2411-2415
[17] 张成峰,谢长生,罗益辉,等.网络存储的统一与虚拟化[J].计算机科学,2006,3(06):11-14
[18] 初佃辉,王显志,王忠杰,等.面向个性化需求的虚拟服务资源整合方法[J].计算机学报,2011,4(12):2370-2380

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!