Computer Science ›› 2010, Vol. 37 ›› Issue (6): 23-27.

Previous Articles     Next Articles

Document Clustering Algorithm Based on Dynamic Interval Mapping

SUN Yong-lin,LIU Zhong   

  • Online:2018-12-01 Published:2018-12-01

Abstract: Archival storage is becoming a research hotspot with information digitization accelerating,where space utihnation and scalability are very important Using content based chunking storage to achieve data deduplication is an effective way to improve storage space utilization, however, it is inefficiency to find shared chunks in all of the huge scale of archival data. We introduced the thought of dynamic interval mapping to information clustering, and presented the DC-DIM(Document Clustering algorithm based on Dynamic Interval Mapping).The algorithm uses chunking and feature extraction methods to generate the fcaturcset of document, and map it on interval links, then choose the document's storage container according to its feature-set's distribution on interval links.By this way, those documents with high similarity(shared a lot of contents) will be clustered, then, it will be very convenient to improve the space utilization and data management.

Key words: Document clustering, Archival storage, Dynamic interval mapping, Space utilization, Scalability

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!