计算机科学 ›› 2017, Vol. 44 ›› Issue (10): 312-317.doi: 10.11896/j.issn.1002-137X.2017.10.056
张兆丰,吴泽民,杜麟,胡磊
ZHANG Zhao-feng, WU Ze-min, DU Lin and HU Lei
摘要: 生物学研究表明,人会 明显地注意 视频中的运动目标。为模拟该特性并快速完成视频显著图的计算,提出一种压缩域时空显著度检测方法(Temporal-Spatial Saliency in Compress Domain model,TS2CD)。分别利用H.264视频中对宏块的残差编码长度和运动矢量编码长度模拟人眼的显著性刺激强度,从而得到视频显著特征。通过线性的加权融合算法,综合两种编码长度得到的空域显著图和时域显著图,得到最终的视频显著图。在3个公开的数据库上的实验表明,TS2CD算法是当前性能最优的方法。
[1] LEE E,GU E,PARK K.Effective small target enhancement and detection in infrared images using saliency map and image intensity[J].Optical Review,2015,22(4):659-668. [2] QIN Y,LH H C,XU Y Q,et al.Saliency detection via cellular automata[C]∥Preceedings of the IEEE Conference on ComputerVision and Pattern Recognition.2015:110-119. [3] XU M,ZHANG H L.Saliency detection with color contrastbased on boundary information and neighbors[J].Visual Computer,2015,31(3):355-364. [4] MA Y F,HUA X S,LU L,et al.A generic framework of user attention model and its application in video summarization[J].IEEE Transactions on Multimedia,2005,7(5):907-919. [5] GHOSH J.Discovering important people and objects for egocentric video summarization[C]∥Preceedings of the IEEE Con-ference on Computer Vision and Pattern Recognition.Washington,2012:1346-1353. [6] WANG W G,SHEN J B,PORIKLI F.Saliency-aware geodesic video object segmentation[C]∥ Preceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:3395-3420. [7] CHANG J,WEI D L,III J.A video representation using temporal superpixels[C]∥Preceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2013:2051-2058. [8] WANG Y L,ZHANG Q,LI B X.Efficient unsupervised abnormal crowd activity detection based on a spatiotemporal saliency detector[C]∥Preceedings of the IEEE Computer Society Winter Conference on Applications of Computer Vision.2016:1-9. [9] FANG Y M,LIN W S,CHEN Z Z,et al.A video saliency detection model in compressed domain[J].IEEE Transactions on Circuits & Systems for Video Technology,2014,24(1):27-38. [10] KHATOONABADI S H,VASCONCELOS N,BAJIC I V,et al.How many bits does it take for a stimulus to be salient?[C]∥ Preceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:5501-5510. [11] KHATOONABADI S H,BAJIC I V,SHAN Y F.Compressed-domain correlates of human fixations in dynamic scenes[J].Multimedia Tools & Applications,2015,74(22):10057-10075. [12] TREISMAN A M,GELADE G.A feature-integration theory of attention[J].Cognitive Psychology,1980,12(1):97-136. [13] PALENICHKA R,LAKHSSASSI A,PALENICHKA M.Visual attention-guided approach to monitoring of medication dispensing using multi-location feature saliency patterns[C]∥Precee-dings of the IEEE International Conference on Computer Vision Workshop.2015:461-468. [14] NINASSI A,MEUR O L,CALLET P L,et al.Task impact on the visual attention in subjective image quality assessment[C]∥Preceedings of the European Signal Processing Conference.2015:1-5. [15] ITTI L,KOCH C,NIEBUR E.A model of saliency-based visual attention for rapid scene analysis[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,1998,20(11):1254-1259. [16] ESCALERA S,RADEVA P,PUJOL O.Complex salient regions for computer vision problems[C]∥Preceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2007:1-8. [17] KIM W,JUNG C,KIM C.Spatiotemporal saliency detection and its applications in static and dynamic scenes[J].IEEE Transactions on Circuits & Systems for Video Technology,2011,21(4):446-456. [18] MEUR O L,THOREAU D,CALLET P L,et al.A spatio-temporal model of the selective human visual attention[C]∥ Preceedings of the IEEE International Conference on Image Processing.2005:1188-1191. [19] ZHU Y P,JACOBSON N,PAN H,et al.Motion-decision based spatiotemporal saliency for video sequences[C]∥Preceedings of the International Conference on Acoustics,Speech&Signal Processing.2011:1333-1336. [20] ZHOU B L,HOU X D,ZHANG L Q.A phase discrepancy analysis of object motion[C]∥Preceedings of the Asian Conference on Computer Vision.2010:225-238. [21] BIAN P,ZHANG L M.Biological plausibility of spectral domain approach for spatiotemporal visual saliency[C]∥Preceedings of the International Conference on Neuro-Information Processing,Auckland.2008:251-258. [22] LI F X,KIM T,HUMAYUN A,et al.Video segmentation by tracking many figure-ground segments[C]∥ Preceedings of the IEEE International Conference on Computer Vision.2013:2192-2199. [23] AKAMINE K,FUKUCHI K,KIMURA A,et al.Fully automatic extraction of salient objects from videos in near real time[J].Computer Journal,2010,55(1):3-14. [24] HUANG C R,CHANG Y J,YANG Z X,et al.Video saliency map detection by dominant camera motion removal[J].IEEE Transactions on Circuits & Systems for Video Technology,2014,24(8):1336-1349. [25] KREYSZIG E.Introductory mathematical statistics principlesand methods[J].Technometrics,1971,13(4):922-925. [26] OHTSU N.A threshold selection method from gray-level histograms[J].IEEE Transactions on Systems Man & Cybernetics,1979,9(1):62-66. [27] BORJI A,CHENG M M,JIANG H,et al.Salient Object Detection:A Survey[J].Eprint Arxiv,2014,16(7):3118. [28] MA Y F,ZHANG H J.A new perceived motion based shot content representation[C]∥Preceedings of the IEEE International Conference on Image Processing.2001:426-429. [29] MA Y F,ZHANG H J.A model of motion attention for video skimming [C]∥Preceedings of the IEEE International Confe-rence on Image Processing.2002:129-132. [30] LIU Z,YAN H B,SHEN L Q,et al.A motion attention model based rate control algorithm for H.264/AVC[C]∥Preceedings of the IEEE/ACIS International Conference on Computer and Information Science.2009:568-573. |
No related articles found! |
|