Computer Science ›› 2016, Vol. 43 ›› Issue (9): 274-279.doi: 10.11896/j.issn.1002-137X.2016.09.055

Previous Articles     Next Articles

Research on Video Copy Detection Algorithm Based on Spatial-Temporal Domain Informative Fusion

YAN Cong, JI Mo-xuan and JI Qing-ge   

  • Online:2018-12-01 Published:2018-12-01

Abstract: In order to effectively utilize unique spatial-temporal domain characteristics of video to enhance the robustness and accuracy of copy detection algorithm,this paper proposed a fast video copy detection algorithm based on spatial-temporal domain informative fusion,which includes a fingerprint extraction algorithm based on spatial-temporal domain informative fusion and two kinds of matching search algorithms of which one is based on inverted-file index and the other is based on matching state machine with asynchronous window strategy.The fingerprint extraction algorithm firstly forms the spatial-temporal domain informative frame by video segmentation,then partitions the informative frame into blocks and extracts DCT coefficient with its median value as threshold to obtain video fingerprint.The matching search algorithm based on inverted-file index sets up inverted-file index table by binary characteristics of fingerprint,then quickly queries fingerprint according to the index table.Combining the matching search algorithm based on matching state machine with asynchronous window strategy,we can change search scope and step size by matching state with nearest neighbor.Meantime,asynchronous window strategy can adopt different extract strategies in online and offline process to accelerate the whole search.The experimental results show that our fingerprint extraction algorithm is robust in the case of Gaussian noise,adding subtitles,spatial shift,rotation and frame drop,and the proposed schemes tend to have great improvement in time efficiency.

Key words: Video copy detection,Spatial-temporal domain informative fusion,Inverted-file index,State automation,Asynchronous window

[1] Hampapur A,Bolle R M.Comparison of distance measures forvideo copy detection[C]∥Proc.IEEE Int.Conf.Multimedia and Expo (ICME).2001:737-740
[2] Lee S,Yoo C D.Robust video fingerprinting for content-basedvideo identification[J].IEEE Transactions on Circuits and Systems for Video Technology,2008,18(7):983-988
[3] Indyk P, Iyengar G, Shivakumar N.Finding pirated video se-quences on the internet:Technical report[R].Stanford University,1999
[4] Chen L,Stentiford F W M.Video sequence matching based on temporal ordinal measurement[J].Pattern Recognition Letters,2008,29(13):1824-1831
[5] Coskun B, Sankur B, Memon N.Spatio-temporal transformbased video hashing[J].IEEE Transactions on Multimedia,2006,8(6):1190-1208
[6] Leon G, Kalva H, Furht B.Videof identification using videotomography[C]∥IEEE International Conference on Multimedia and Expo.IEEE,2009:1030-1033
[7] Ji Qing-ge,Tan Zhi-feng,Lu Zhe-ming,et al.An Improved VideoIdentification Scheme Based on Video Tomography[J].IEICE Transactions on Information and Systems,2014,97(4):919-927
[8] Oostveen J,Kalker T,Haitsma J.Feature extraction and a database strategy for video fingerprinting [M]∥Recent Advances in Visual Information Systems.Springer Berlin Heidelberg,2002:117-128
[9] Zhao Wan-Lei,Ngo Chong-Wah,Tan Hung-Khoon,et al.Near-duplicate keyframe identification with interest point matching and pattern learning[J].IEEE Transactions on Multimedia,2007,9(5):1037-1048
[10] Barrios J M,Bustos B.Competitive content-based video copy detection using global descriptors[J].Multimedia tools and applications,2013,62(1):75-110
[11] Esmaeili M M,Ward R K.Robust video hashing based on temporally informative representative images[C]∥International Conference on Consumer Electronics (ICCE).2010:179-180
[12] Malek Esmaeili M,Ward R K,Fatourechi M.Fast matching for video/audio fingerprinting algorithms[C]∥IEEE International Workshop on Information Forensics and Security (WIFS).2011:1-6
[13] MUSCLE-VCD-2007.http://wwwrocq.inria.fr/imedia/civr-bench/index.html
[14] Awad G,Over P,Kraaij W.Content-based video copy detection benchmarking at TRECVID[J].ACM Transactions on Information Systems,2014,32(3):1-40

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!