Computer Science ›› 2018, Vol. 45 ›› Issue (6A): 601-605.

• Interdiscipline & Application • Previous Articles    

Design of Storage Platform for Large Scale Data Based on SWIFT System

LI Peng-yuan1,ZHANG Zhi-yong2   

  1. Beijing Institute of Tracking and Telecommunications Technology,Beijing 100089,China1
    Taiyuan Satellite Launch Center,Taiyuan 030000,China2
  • Online:2018-06-20 Published:2018-08-03

Abstract: With the rapid development of China’s space activities,storing the massive data based on the huge data stora-ge platform becomes increasingly important.This paper presented a cloud storage solution based on one distributed storage system which is named SWIFT,and built the infrastructure architecture for this storage platform.The design of SWIFT mainly includes four parts,the hash process of data storage,Ring,Partition,and Replica policy.And this paper verified the validity of the key design of SWIFT through the way of data simulation.

Key words: Distributed storage, Partition, Replica, Ring, SWIFT

CLC Number: 

  • TP393.07
[1]刘鹏.云计算——将计算变成水和电.中国计算机学会通讯,2009,5(10):49-54.
[2]WEN X,GU G,LI Q,et al.Comparison of open-source cloud management platforms:OpenStack and OpenNebula∥2012 9th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).IEEE,2012:2457-2461.
[3]GUPTA R.Above the Clouds:A view of cloud computing[J].Eecs Department University of California Berkeley,2009,53(4):50-58.
[4]陆平,赵培,左奇.OpenStack系统架构设计实战[M].北京:机械工业出版社,2016.
[5]ARNOLD J.OpenStack Swift:Using,Administering,and Deve- loping for Swift Object Storage[M].O’Reilly Media,Inc.,2014.
[6]TOOR S,TOEBBICKE R,RESINES M Z,et al.Investigating an open source cloud storage infrastructure for CERN-specific data analysis∥2012 IEEE 7th International Conference on Networking,Architecture and Storage (NAS).IEEE,2012:84-88.
[7]李俊,李勇.联邦式异构数据库应用系统的集成框架和实现技术研究[J].计算机应用研究,2001,18(4):19-22.
[8]钟茂生.软件设计模式及其使用[J].计算机应用,2002,22(8):32-35.
[9]LEWIN D M.Consistent hashing and random trees:algorithms for caching in distributed networks[D].Massachusetts Institute of Technology,1998.
[10]武志学,赵阳,马超英.云存储系统——Swift的原理、架构及实践[M].北京:人民邮电出版社,2015.
[11]GODFREY B,LAKSHMINARAYANAN K,SURANA S,et al.Load balancing in dynamic structured P2P systems∥Twenty-third Annual Joint Conference of the IEEE Computer and Communications Societies(INFOCOM 2004).IEEE,2004:2253-2262.
[1] LU Chen-yang, DENG Su, MA Wu-bin, WU Ya-hui, ZHOU Hao-hao. Federated Learning Based on Stratified Sampling Optimization for Heterogeneous Clients [J]. Computer Science, 2022, 49(9): 183-193.
[2] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[3] TANG Qing-hua, WANG Mei, TANG Chao-chen, LIU Xin, LIANG Wen. PDR Indoor Positioning Method Based on M2M Encounter Region [J]. Computer Science, 2022, 49(9): 283-287.
[4] CHENG Zhang-tao, ZHONG Ting, ZHANG Sheng-ming, ZHOU Fan. Survey of Recommender Systems Based on Graph Learning [J]. Computer Science, 2022, 49(9): 1-13.
[5] WANG Guan-yu, ZHONG Ting, FENG Yu, ZHOU Fan. Collaborative Filtering Recommendation Method Based on Vector Quantization Coding [J]. Computer Science, 2022, 49(9): 48-54.
[6] CHAI Hui-min, ZHANG Yong, FANG Min. Aerial Target Grouping Method Based on Feature Similarity Clustering [J]. Computer Science, 2022, 49(9): 70-75.
[7] SUN Xiao-han, ZHANG Li. Collaborative Filtering Recommendation Algorithm Based on Rating Region Subspace [J]. Computer Science, 2022, 49(7): 50-56.
[8] YANG Xiao, WANG Xiang-kun, HU Hao, ZHU Min. Survey on Visualization Technology for Equipment Condition Monitoring [J]. Computer Science, 2022, 49(7): 89-99.
[9] XU Ming-yue. Study on Information Sharing and Channel Strategy of Platform in Consideration ofInformation Leakage and Information Investing Cost [J]. Computer Science, 2022, 49(6A): 744-752.
[10] HUANG Guo-xing, YANG Ze-ming, LU Wei-dang, PENG Hong, WANG Jing-wen. Solve Data Envelopment Analysis Problems with Particle Filter [J]. Computer Science, 2022, 49(6A): 159-164.
[11] YUAN Hao-nan, WANG Rui-jin, ZHENG Bo-wen, WU Bang-yan. Design and Implementation of Cross-chain Trusted EMR Sharing System Based on Fabric [J]. Computer Science, 2022, 49(6A): 490-495.
[12] YIN Xiu, LIU Xi-lin, LIU Xi-yu. Study on Computing Capacity of Novel Numerical Spiking Neural P Systems with MultipleSynaptic Channels [J]. Computer Science, 2022, 49(6A): 223-231.
[13] CAI Xiao-juan, TAN Wen-an. Improved Collaborative Filtering Algorithm Combining Similarity and Trust [J]. Computer Science, 2022, 49(6A): 238-241.
[14] YU Shu-hao, ZHOU Hui, YE Chun-yang, WANG Tai-zheng. SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion [J]. Computer Science, 2022, 49(6A): 256-260.
[15] HE Yi-chen, MAO Yi-jun, XIE Xian-fen, GU Wan-rong. Matrix Transformation and Factorization Based on Graph Partitioning by Vertex Separator for Recommendation [J]. Computer Science, 2022, 49(6A): 272-279.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!