计算机科学 ›› 2010, Vol. 37 ›› Issue (2): 65-70.

• 计算机网络与信息安全 • 上一篇    下一篇

基于DHT的分布式索引技术研究与实现

吴炜,苏永红,李瑞轩,卢正鼎   

  1. (华中科技大学计算机科学与技术学院 武汉430074)
  • 出版日期:2018-12-01 发布日期:2018-12-01
  • 基金资助:
    本文受国家自然科学基金项目(60873225,60773191,70771043),国家高技术研究发展计划(863计划)项目(2007AA01Z403)资助。

Research and Implementation of Distributed Index Based on DHT

WU Wei,SU Yong-hong,LI Rui-xuan,LU Zheng-ding   

  • Online:2018-12-01 Published:2018-12-01

摘要: 针对索引创建和维护效率不高的问题,设计了一种基于DHT(Distributed Hash Table)的分布式倒排索引构建算法。该算法利用基于改进的Chord网络的分布式哈希表技术,将分词后的结果分散到多个索引服务器上并行构建索引,同时采用前驱列表定位和减少服务器定位延迟的技术,大大缩短了索引构建时间。通过采用统一调度的基于分块的增量式倒排索引更新策略,索引更新时不再需要移动已有的索引文件,提高了索引更新效率。利用周期性稳定算法和前驱列表定位提高了系统的稳定性、容错性和索引的一致性。

关键词: 分布式索引,分布式哈希表,Chord网络

Abstract: A distributed inverted index's building method based on DHT (Distributed Hash Table) was adopted to improve the index's creating and updating efficiency.The arithmetic, using the DHT technology based on improved Chord network,hashes the terms and their relational information to the distributed index servers and builds the index parallely. This method reduces the index's building time through distributing a task to many nodes. The strategies of scheduling the index building task through chained index management servers and the incremental distributed inverted index updating method were used,which could assure index's consistency and updating efficiency.

Key words: Distributed index, Distributed hash table, Chord network

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!