计算机科学 ›› 2013, Vol. 40 ›› Issue (3): 228-231.

• 软件与数据库技术 • 上一篇    下一篇

基于HBase的并行BFS方法

强彦,卢军佐,刘涛,裴博   

  1. (太原理工大学计算机科学与技术学院 太原030024)
  • 出版日期:2018-11-16 发布日期:2018-11-16

HBase Based Parallel BFS Method

  • Online:2018-11-16 Published:2018-11-16

摘要: NoSQL数据库作为下一代巨型数据的存储模式,在科学计算和商业计算领域均发挥着重要作用,受到当前学术界和企业界的广泛关注。提出一种新的基于NoSQL数据库HBase的并行求取最短路径树的方法。首先利用Watts-Strogatz模型完成对巨型网络的数学建模,这种建模方式使得网络模型具有一定的聚类效果;其次利用HBase最近发布的Coprocessor简化和改进并行BFS方法,提高其计算效率。此外,还设计并实施了大量实验,得出了巨型网络的最短路径树,验证了该算法的正确性和有效性;同时对比其它路径算法,验证了该算法的高效性。

关键词: HBase,协处理器,并行广度优先算法,Mapreduce, NoSQL数据库

Abstract: As the next generation of storage model of giant data, NoSQL database plays an important role both in the fields of scientific computing and commercial computing, and has gained wide attention in academia and business community. We presented a new parallel method based on HBase to gain the shortest path tree. Firstly, Watts-strogatz mode was used to complete the mathematical modeling of giant network, therefore the network would have some cluster effects. Secondly,we made a simplification and improvement to the parallel breath-first search method,in order to improve its calculation efficiency. In addition, we designed and implemented a large number of experiments. According to the experiment results,we obtained the giant network shortest path trec,and verified the correctness and validity of the algorithm. Meanwhile,Contrast to the other path algorithm,we verified the efficiency of the algorithm.

Key words: HBase, Ccoprocessor, Parallel BFS, Mapreduce, NoSQL database

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!