计算机科学 ›› 2016, Vol. 43 ›› Issue (Z11): 575-577.doi: 10.11896/j.issn.1002-137X.2016.11A.130

• 智能系统及应用 • 上一篇    下一篇

KingCloud:智能对象归档系统

缪嘉嘉,付印金,毛捍东   

  1. 解放军理工大学指挥信息系统学院 南京210007,解放军理工大学指挥信息系统学院 南京210007,国防科学技术大学C4ISR重点实验室 长沙410073
  • 出版日期:2018-12-01 发布日期:2018-12-01
  • 基金资助:
    本文受总装预研基金(9140A15070414JB25224),国家自然科学基金(61402518)资助

KingCloud:Object Oriented Archiving System

MIAO Jia-jia, FU Yin-jin and MAO Han-dong   

  • Online:2018-12-01 Published:2018-12-01

摘要: 随着信息化进程的不断推进,生产系统积累了大量的数据,形成了归档需求;与此同时,数据信息类型不断丰富,非结构化数据的处理是挖掘数据价值的关键。设计并实现了KingCloud智能对象归档系统,通过文档分类技术实现了文本文件的分类,并提供了文档逻辑视图;利用图像识别、视频关键帧提取等技术实现图片和视频文件的内容元数据获取,在整体存储结构上结合文件系统语义研究对文件预取、存储缓存、数据布局和策略感知等方面进行优化,能够对数据进行智能的分类、归纳总结、智能的发现和预测及智能的分析,有效提升了存储系统的服务能力、服务质量和服务性能。

关键词: 文件系统语义,归档系统,文档分类,数据布局,文件预取

Abstract: With the ceaseless propulsion of informatization process,a great deal of data accumulating in the production system resulting in archiving demand.Meanwhile,with increasingly enriching types of data information,big data technology enhances the function of unstructured data.This paper designed and realized the KingCloud intelligent object archiving system,which achieves classification of text files through document classification technology,provides lo-gic views of documents and achieves the acquisition of content elements through image identification,video key frame and other technologies.As for the overall storage structure,document prefetching,memory buffer,data layout and strategy perception etc.can be optimized by combining the semantic studies of file system,and data can be intelligently classified,summarized,discovered,predicted and analyzed to remarkably improve the service ability,service quality and service performance of memory system.

Key words: File system semantic,Achieve system,Document classification,Data layout,File prefetching

[1] Beaver D,Kumar S,Li H.Finding a needle in Haystack:Facebook’s photo storage 2010[C]∥Proc of the 10th USENIX Symp on Operating Systems Design and Implementation.2010:30-35
[2] 曹强,黄建忠,万继光,等.海量网络存储系统原理与设计[M].华中科技大学出版社,2010
[3] Zeng L,Zhou K,Shi Z,et al.HUSt:a heterogeneous unified storage system for GIS grid[C]∥Proceedings of SC ’06:Proceedings of the 2006 ACM/IEEE Conference on Super Computing.New York,NY,USA:ACM,2006:325
[4] Semantic file systems.http://www.objs.com/survey/OFSExt.htm
[5] Bhagwat D,Polyzotis N.Searching a file system using inferred semantic links[C]∥Proceedings of HYPERTEXT ’05:Proceedings of the sixteenth ACM conference on Hypertext and hypermedia.New York,NY,USA:ACM,2005:85-87
[6] Kroeger T M,Long D D E.The Case for Efficient File Access Pattern Modeling[C]∥Proceedings of HOTOS ’99.Washington,DC,USA:IEEE Computer Society,1999:14
[7] Agrawal N,Bolosky W J,Douceur J R,et al.A five-year study of file-system metadata[C]∥Useninx Conference on File and Storage Technology.2007

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!