计算机科学 ›› 2016, Vol. 43 ›› Issue (9): 274-279.doi: 10.11896/j.issn.1002-137X.2016.09.055

• 图形图像与模式识别 • 上一篇    下一篇

基于时空域信息融合的视频拷贝检测算法研究

严聪,纪墨轩,纪庆革   

  1. 中山大学数据科学与计算机学院 广州510006,东北大学软件学院 沈阳110000,中山大学数据科学与计算机学院 广州510006
  • 出版日期:2018-12-01 发布日期:2018-12-01
  • 基金资助:
    本文受NSFC-1广东联合基金(U0735001)资助

Research on Video Copy Detection Algorithm Based on Spatial-Temporal Domain Informative Fusion

YAN Cong, JI Mo-xuan and JI Qing-ge   

  • Online:2018-12-01 Published:2018-12-01

摘要: 为了有效利用视频独有的时空域特性来提高视频拷贝检测算法的鲁棒性和精度,提出一种基于时空域信息融合的快速拷贝检测算法。该算法包括基于时空域信息融合的指纹提取算法、基于倒排索引的匹配搜索算法和结合异步滑窗策略的基于匹配状态机的匹配搜索算法。指纹提取算法首先将视频分段形成时空域信息帧,然后对该信息帧进行分块,提取DCT系数后,利用其中值进行阈值化得到视频指纹。基于倒排索引的搜索算法根据指纹的二值性特点建立倒排索引表,然后通过索引表快速查询指纹。结合异步滑窗策略的基于匹配状态自动机的搜索算法,利用与最近邻之间的匹配状态来改变搜索范围和步长,而异步滑窗策略通过对在线和离线过程采用不同的提取策略,减少搜索量,加快搜索速度。实验结果表明,提取的指纹对噪声模糊、添加字幕、空间偏移、旋转、掉帧具有较好的鲁棒性,同时提出的搜索方案在时间效率上也有较大的提升。

关键词: 视频拷贝检测,时空域信息融合,倒排索引,状态自动机,异步滑窗

Abstract: In order to effectively utilize unique spatial-temporal domain characteristics of video to enhance the robustness and accuracy of copy detection algorithm,this paper proposed a fast video copy detection algorithm based on spatial-temporal domain informative fusion,which includes a fingerprint extraction algorithm based on spatial-temporal domain informative fusion and two kinds of matching search algorithms of which one is based on inverted-file index and the other is based on matching state machine with asynchronous window strategy.The fingerprint extraction algorithm firstly forms the spatial-temporal domain informative frame by video segmentation,then partitions the informative frame into blocks and extracts DCT coefficient with its median value as threshold to obtain video fingerprint.The matching search algorithm based on inverted-file index sets up inverted-file index table by binary characteristics of fingerprint,then quickly queries fingerprint according to the index table.Combining the matching search algorithm based on matching state machine with asynchronous window strategy,we can change search scope and step size by matching state with nearest neighbor.Meantime,asynchronous window strategy can adopt different extract strategies in online and offline process to accelerate the whole search.The experimental results show that our fingerprint extraction algorithm is robust in the case of Gaussian noise,adding subtitles,spatial shift,rotation and frame drop,and the proposed schemes tend to have great improvement in time efficiency.

Key words: Video copy detection,Spatial-temporal domain informative fusion,Inverted-file index,State automation,Asynchronous window

[1] Hampapur A,Bolle R M.Comparison of distance measures forvideo copy detection[C]∥Proc.IEEE Int.Conf.Multimedia and Expo (ICME).2001:737-740
[2] Lee S,Yoo C D.Robust video fingerprinting for content-basedvideo identification[J].IEEE Transactions on Circuits and Systems for Video Technology,2008,18(7):983-988
[3] Indyk P, Iyengar G, Shivakumar N.Finding pirated video se-quences on the internet:Technical report[R].Stanford University,1999
[4] Chen L,Stentiford F W M.Video sequence matching based on temporal ordinal measurement[J].Pattern Recognition Letters,2008,29(13):1824-1831
[5] Coskun B, Sankur B, Memon N.Spatio-temporal transformbased video hashing[J].IEEE Transactions on Multimedia,2006,8(6):1190-1208
[6] Leon G, Kalva H, Furht B.Videof identification using videotomography[C]∥IEEE International Conference on Multimedia and Expo.IEEE,2009:1030-1033
[7] Ji Qing-ge,Tan Zhi-feng,Lu Zhe-ming,et al.An Improved VideoIdentification Scheme Based on Video Tomography[J].IEICE Transactions on Information and Systems,2014,97(4):919-927
[8] Oostveen J,Kalker T,Haitsma J.Feature extraction and a database strategy for video fingerprinting [M]∥Recent Advances in Visual Information Systems.Springer Berlin Heidelberg,2002:117-128
[9] Zhao Wan-Lei,Ngo Chong-Wah,Tan Hung-Khoon,et al.Near-duplicate keyframe identification with interest point matching and pattern learning[J].IEEE Transactions on Multimedia,2007,9(5):1037-1048
[10] Barrios J M,Bustos B.Competitive content-based video copy detection using global descriptors[J].Multimedia tools and applications,2013,62(1):75-110
[11] Esmaeili M M,Ward R K.Robust video hashing based on temporally informative representative images[C]∥International Conference on Consumer Electronics (ICCE).2010:179-180
[12] Malek Esmaeili M,Ward R K,Fatourechi M.Fast matching for video/audio fingerprinting algorithms[C]∥IEEE International Workshop on Information Forensics and Security (WIFS).2011:1-6
[13] MUSCLE-VCD-2007.http://wwwrocq.inria.fr/imedia/civr-bench/index.html
[14] Awad G,Over P,Kraaij W.Content-based video copy detection benchmarking at TRECVID[J].ACM Transactions on Information Systems,2014,32(3):1-40

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!