计算机科学 ›› 2017, Vol. 44 ›› Issue (10): 312-317.doi: 10.11896/j.issn.1002-137X.2017.10.056

• 图形图像与模式识别 • 上一篇    下一篇

基于压缩域编码长度的视频显著性检测

张兆丰,吴泽民,杜麟,胡磊   

  1. 中国人民解放军理工大学通信工程学院 南京210007,中国人民解放军理工大学通信工程学院 南京210007,中国人民解放军理工大学通信工程学院 南京210007,中国人民解放军理工大学通信工程学院 南京210007
  • 出版日期:2018-12-01 发布日期:2018-12-01
  • 基金资助:
    本文受国家自然科学基金(61501509)资助

Video Saliency Detection Based on Compressed Domain Coding Length

ZHANG Zhao-feng, WU Ze-min, DU Lin and HU Lei   

  • Online:2018-12-01 Published:2018-12-01

摘要: 生物学研究表明,人会 明显地注意 视频中的运动目标。为模拟该特性并快速完成视频显著图的计算,提出一种压缩域时空显著度检测方法(Temporal-Spatial Saliency in Compress Domain model,TS2CD)。分别利用H.264视频中对宏块的残差编码长度和运动矢量编码长度模拟人眼的显著性刺激强度,从而得到视频显著特征。通过线性的加权融合算法,综合两种编码长度得到的空域显著图和时域显著图,得到最终的视频显著图。在3个公开的数据库上的实验表明,TS2CD算法是当前性能最优的方法。

关键词: 视频显著性,压缩域,时空显著度,编码长度

Abstract: Biology studies show that people will pay much attention to the moving object when they watch a video.In order to simulate this feature and detect the salient region rapidly,we proposed the temporal-spatial saliency in compress domain model(TS2CD).By respectively using H.264 residual coding length and motion vector coding length,we simulated the salient stimulus intensity and then got video saliency features.Finally,we used the linear weighted fusion algorithm to get the final video saliency maps.Experimental results on three public datasets demonstrate that our model outperforms state-of-the-art methods.

Key words: Video saliency,Compress domain,Temporal-Spatial saliency,Coding length

[1] LEE E,GU E,PARK K.Effective small target enhancement and detection in infrared images using saliency map and image intensity[J].Optical Review,2015,22(4):659-668.
[2] QIN Y,LH H C,XU Y Q,et al.Saliency detection via cellular automata[C]∥Preceedings of the IEEE Conference on ComputerVision and Pattern Recognition.2015:110-119.
[3] XU M,ZHANG H L.Saliency detection with color contrastbased on boundary information and neighbors[J].Visual Computer,2015,31(3):355-364.
[4] MA Y F,HUA X S,LU L,et al.A generic framework of user attention model and its application in video summarization[J].IEEE Transactions on Multimedia,2005,7(5):907-919.
[5] GHOSH J.Discovering important people and objects for egocentric video summarization[C]∥Preceedings of the IEEE Con-ference on Computer Vision and Pattern Recognition.Washington,2012:1346-1353.
[6] WANG W G,SHEN J B,PORIKLI F.Saliency-aware geodesic video object segmentation[C]∥ Preceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:3395-3420.
[7] CHANG J,WEI D L,III J.A video representation using temporal superpixels[C]∥Preceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2013:2051-2058.
[8] WANG Y L,ZHANG Q,LI B X.Efficient unsupervised abnormal crowd activity detection based on a spatiotemporal saliency detector[C]∥Preceedings of the IEEE Computer Society Winter Conference on Applications of Computer Vision.2016:1-9.
[9] FANG Y M,LIN W S,CHEN Z Z,et al.A video saliency detection model in compressed domain[J].IEEE Transactions on Circuits & Systems for Video Technology,2014,24(1):27-38.
[10] KHATOONABADI S H,VASCONCELOS N,BAJIC I V,et al.How many bits does it take for a stimulus to be salient?[C]∥ Preceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:5501-5510.
[11] KHATOONABADI S H,BAJIC I V,SHAN Y F.Compressed-domain correlates of human fixations in dynamic scenes[J].Multimedia Tools & Applications,2015,74(22):10057-10075.
[12] TREISMAN A M,GELADE G.A feature-integration theory of attention[J].Cognitive Psychology,1980,12(1):97-136.
[13] PALENICHKA R,LAKHSSASSI A,PALENICHKA M.Visual attention-guided approach to monitoring of medication dispensing using multi-location feature saliency patterns[C]∥Precee-dings of the IEEE International Conference on Computer Vision Workshop.2015:461-468.
[14] NINASSI A,MEUR O L,CALLET P L,et al.Task impact on the visual attention in subjective image quality assessment[C]∥Preceedings of the European Signal Processing Conference.2015:1-5.
[15] ITTI L,KOCH C,NIEBUR E.A model of saliency-based visual attention for rapid scene analysis[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,1998,20(11):1254-1259.
[16] ESCALERA S,RADEVA P,PUJOL O.Complex salient regions for computer vision problems[C]∥Preceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2007:1-8.
[17] KIM W,JUNG C,KIM C.Spatiotemporal saliency detection and its applications in static and dynamic scenes[J].IEEE Transactions on Circuits & Systems for Video Technology,2011,21(4):446-456.
[18] MEUR O L,THOREAU D,CALLET P L,et al.A spatio-temporal model of the selective human visual attention[C]∥ Preceedings of the IEEE International Conference on Image Processing.2005:1188-1191.
[19] ZHU Y P,JACOBSON N,PAN H,et al.Motion-decision based spatiotemporal saliency for video sequences[C]∥Preceedings of the International Conference on Acoustics,Speech&Signal Processing.2011:1333-1336.
[20] ZHOU B L,HOU X D,ZHANG L Q.A phase discrepancy analysis of object motion[C]∥Preceedings of the Asian Conference on Computer Vision.2010:225-238.
[21] BIAN P,ZHANG L M.Biological plausibility of spectral domain approach for spatiotemporal visual saliency[C]∥Preceedings of the International Conference on Neuro-Information Processing,Auckland.2008:251-258.
[22] LI F X,KIM T,HUMAYUN A,et al.Video segmentation by tracking many figure-ground segments[C]∥ Preceedings of the IEEE International Conference on Computer Vision.2013:2192-2199.
[23] AKAMINE K,FUKUCHI K,KIMURA A,et al.Fully automatic extraction of salient objects from videos in near real time[J].Computer Journal,2010,55(1):3-14.
[24] HUANG C R,CHANG Y J,YANG Z X,et al.Video saliency map detection by dominant camera motion removal[J].IEEE Transactions on Circuits & Systems for Video Technology,2014,24(8):1336-1349.
[25] KREYSZIG E.Introductory mathematical statistics principlesand methods[J].Technometrics,1971,13(4):922-925.
[26] OHTSU N.A threshold selection method from gray-level histograms[J].IEEE Transactions on Systems Man & Cybernetics,1979,9(1):62-66.
[27] BORJI A,CHENG M M,JIANG H,et al.Salient Object Detection:A Survey[J].Eprint Arxiv,2014,16(7):3118.
[28] MA Y F,ZHANG H J.A new perceived motion based shot content representation[C]∥Preceedings of the IEEE International Conference on Image Processing.2001:426-429.
[29] MA Y F,ZHANG H J.A model of motion attention for video skimming [C]∥Preceedings of the IEEE International Confe-rence on Image Processing.2002:129-132.
[30] LIU Z,YAN H B,SHEN L Q,et al.A motion attention model based rate control algorithm for H.264/AVC[C]∥Preceedings of the IEEE/ACIS International Conference on Computer and Information Science.2009:568-573.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!