Computer Science ›› 2014, Vol. 41 ›› Issue (Z11): 393-395.

Previous Articles     Next Articles

Design and Realization of Distributed Big Data Management System

CHEN Hai-yan   

  • Online:2018-11-14 Published:2018-11-14

Abstract: With the pretty rapid development of cloud computing,internet of things,mobile internet,and other technologies,mass data grows in those areas in violent speed.Big Data provides a possibility of handling mass data,which acts as a subversive technique.By the way,traditional relation database is no more effective of mass data that causes distributed database NoSQL to appear and evolve.Facing with actual and various difficulties,we designed and realized a new distributed big data management system (DBDMS),which is based on Hadoop and NoSQL techniques,and it provides big data real-time collection,search and permanent storage.Proved by some experiment,DBDMS can enhance the processing capacity of mass data,and very fits for mass log backup and retrieval,mass network packet grab and analysis,and other applied areas.

Key words: Big data,Distributed,Data storage,Data query,Hadoop,NoSQL

[1] Bari N,Mani G,Berkovich S.Internet of Things as a Methodological Concept[C]∥Fourth International Conference on Computing for Geospatial Research and Application.2013:48-50
[2] Dikaiakos M D,Pallis G,Katsaros D.Cloud Computing:Distri-buted Internet Computing for IT and Scientific Research[C]∥IEEE Internet Computing.2009:10-13
[3] Song Juan,Tang Shou-lian.Operator’s Mobile Internet Strategy in the process of Converged Network[C]∥2010 International Conference Management and Service Science (MASS).2010:1-4
[4] Wu Yu-lin,Gong Guang-hong.A Fully Distributed CollectionTechnology for Mass Simulation Data[C]∥2013 Fifth International Conference Computational and Information Sciences (ICCIS).2013:1679-1683
[5] Ringel D M,Skiera B.Understanding Competition using BigConsumer Search Data [C]∥2014 47th Hawaii International Conferences,System Sciences (HICSS).2014:3129-3138
[6] Membrey P,Chan K C C,Demchenko Y.A Disk Based Stream Oriented Approach For Storing Big Data[C]∥2013 International Conference Collaboration Technologies and Systems (CTS).2013:56-64
[7] Han J,Ishii M,Makino H.A Hadoop Performance Model forMulti-Rack Clusters[C]∥2013 5th International Conference Computer Science and Information Technology (CSIT).2013:265-274
[8] He Chen,Weitzel D,Swanson D,et al.HOG:Distributed Ha-doop MapReduce on the Grid[C]∥2012 SC Companion High Performance Computing,Networking,Storage and Analysis (SCC).2012:1276-1283
[9] von der Weth C,Datta A.Multiterm Keyword Search in NoSQL Systems[C]∥Digital Object Identifier.2012:34-42
[10] Kaur K,Rani R.Modeling and Querying Data in NoSQL Databases[C]∥2013 IEEE International Conference Big Data.2013:1-7

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!