Computer Science ›› 2017, Vol. 44 ›› Issue (12): 266-273.doi: 10.11896/j.issn.1002-137X.2017.12.048

Previous Articles     Next Articles

Research on Parallel Algorithm of Image Saliency Estimation

SHEN Hong and LI Xiao-guang   

  • Online:2018-12-01 Published:2018-12-01

Abstract: Saliency estimation has become an important tool in digital image processing.However,in the existing algorithms,it is difficult to take into account the accuracy and real-time application requirements.In view of the characteristics of the model of the bottom-up image estimation model,a parallel algorithm was proposed to meet the requirement of real-time application,which is based on the advantages of NVIDIA CUDA parallel computing architecture.Super pixel segmentation and Warshall graph theory are combined for edge blurred vision and background probability estimation.Based on the contrast model,the compact area with lower difference of color is high lighted to obtain the optimized saliency map.With the prerequisite of the detection performance,the efficiency was improved,and the requirements of real time application were met.

Key words: Saliency,Background probability,CUDA parallel computing,Warshall graph theory,Fuzzy edge vision

[1] ITTI L,KOCH C,NIEBUR E.A model of saliency-based visual attention for rapid scene analysis[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,1998,20(11):1254-1259.
[2] DESIMONE R,DUNCAN J.Neural mechanisms of selectivevisual attention[J].Annual Review of Neuroscience,1995,18(1):193-222.
[3] TEUBER H.Physiological psychology[J].Annual Review ofPsychology,1955,6(1):267-296.
[4] BORJI A,SIHITE D N,ITTI L.Salient Object Detection:ABenchmark[M]∥Computer Vision-ECCV 2012.Springer Berlin Heidelberg,2012:414-429.
[5] DING M,TONG R F.Content-aware copying and pasting in ima-ges[J].The Visual Computer,2010,6(6-8):721-729.
[6] DING Y,XIAO J,YU J.Importance filtering for image retarge-ting[C]∥IEEE Conference on Computer Vision & Pattern Re-cognition.IEEE Computer Society,2011:89-96.
[7] CHENG M,MITRA N J,HUANG X,et al.Global ContrastBased Salient Region Detection[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2015,7(3):569-582.
[8] PERAZZI F,KRHENBHL P,PRITCH Y,et al.Saliency filters:Contrast based filtering for salient region detection[C]∥2013 IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2012:733-740.
[9] YANG C,ZHANG L,LU H,et al.Saliency Detection viaGraph-Based Manifold Ranking[C]∥2013 IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer So-ciety,2013:3166-3173.
[10] JUDD T,EHINGER K,DURAND F,et al.Learning to predict where humans look [C]∥International Conference on Computer Vision.2010:2106-2113.
[11] CHEN T,CHENG M M,TAN P,et al.Sketch Photo:internet image montage[J].ACM Transactions on Graphics (TOG),2009,8(5):124.
[12] PENG H,LI B,XIONG W.RGBD Salient Object Detection:A Benchmark and Algorithms[M]∥ Computer Vision-ECCV 2014.Springer International Publishing,2014:92-109.
[13] ZHU W,LIANG S,WEI Y,et al.Saliency Optimization from Robust Background Detection[C]∥2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2014:2814-2821.
[14] REN C Y,REID I.gSLIC:a real-time implementation of SLIC superpixel segmentation[J].University of Oxford,2011.
[15] HUAZHU F,XIAOCHU C,ZHUOWEN T.Cluster-based co-saliency detection[J].IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society,2013,22(10):3766.
[16] ZHI L,ZOU W,MEUR O L.Saliency Tree:A Novel SaliencyDetection Framework[J].IEEE Transactions on Image Proces-sing A Publication of the IEEE Signal Processing Society,2014,3(5):1937-1952.
[17] PENG H W,LI B,JI R,et al.Salient Object Detection via Low-Rank and Structured Sparse Matrix Decomposition[C]∥AAAI Conference on Artificial Intelligence.2013:796-802.
[18] WANG L,XUE J,HENG N,et al.Automatic salient object extraction with contextual cue[C]∥2011 IEEE International Conference on Computer Vision (ICCV).IEEE,2011:105-112.
[19] WEI Y,WEI F,ZHU W,et al.Geodesic saliency using back-ground priors[M]∥Computer Vision-ECCV 2012.Springer Berlin Heidelberg,2012:29-42.
[20] KOCH C,ULLMAN S.Shifts in selective visual attention:towards the underlying neural circuitry[M]∥Matters of Intelligence.Springer Netherlands,1987:115-141.
[21] KO B C,NAM J Y.Object-of-interest image segmentation based on human attention and semantic region clustering[J].Journal of the Optical Society of America A Optics Image Science & Vision,2006,3(10):2462-2470.
[22] HAN J,NGAN K N,LI M,et al.Unsupervised extraction of visual attention objects in color images[J].IEEE Transactions on Circuits and Systems for Video Technology,2006,6(1):141-145.
[23] GAO D,MAHADEVAN V,VASCONCELOS N.The discriminant center-surround hypothesis for bottom-up saliency[C]∥ International Conferen ce on Information Processing Systems.2007:497-504.
[24] LIU T,YUAN Z,SUN J,et al.Learning to Detect a Salient Object[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2010,3(33):353-367.
[25] YAN Q,XU L,SHI J,et al.Hierarchical saliency detection[C]∥2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2013:1155-1162.
[26] SHEN X,WU Y.A unified approach to salient object detection via low rank matrix recovery[C]∥2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2012:853-860.
[27] ZHENG L,WANG S,LIU Z,et al.Fast Image Retrieval:Query Pruning and Early Termination[J].IEEE Transactions on Multimedia,2015,7(5):648-659.
[28] GOFERMAN S,ZELNIK-MANOR L,TAL A.Context-aware saliency detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,4(10):1915-1926.
[29] ACHANTA R,SHAJI A,SMITH K,et al.SLIC Superpixels[J].Epfl,2010.
[30] MORI G.Guiding Model Search Using Segmentation[C]∥Tenth IEEE International Conference on Computer Vision.IEEE Computer Society, 2005:1417-1423.
[31] VEDALDI A,SOATTO S.Quick Shift and Kernel Methods for Mode Seeking[M]∥Computer Vision-ECCV 2008.Springer Berlin Heidelberg,2008:705-718.
[32] ZHANG Y,MAO Z,LI J,et al.Salient region detection for complex background images using integrated features[J].Information Sciences,2014,1:586-600.
[33] ANDRADE G,RAMOS G,MADEIRA D,et al.G-DBSCAN:A GPU Accelerated Algorithm for Density-based Clustering[J].Procedia Computer Science,2013,8(1):369-378.
[34] ESTER M,JORG S,XU X.A density-based algorithm for discovering clusters in large spatial databases with noise[C]∥ International Conference on Knowledge Discovery and Data Mi-ning.AAAI Press,1996:226-231.
[35] JIANG H,WANG J,YUAN Z,et al.Salient Object Detection:A Discriminative Regional Feature Integration Approach[C]∥Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2013:2083-2090.
[36] ACHANTA R,HEMAMI S,ESTRADA F,et al.Frequency-tuned Salient Region Detection[C]∥IEEE International Confe-rence on Computer Vision and Pattern Recognition (CVPR 2009).2009:1597-1604.
[37] CHENG M M,ZHANG F L,MITRA N J,et al.RepFinder:finding approximately repeated scene elements for image editing [J].ACM Transactions on Graphics (TOG).ACM,2010,29(4):83.
[38] CHRISTOPOULOS C,SKODRAS A,EBRAHIMI T.The JPEG2000 still image coding system:an overview[J].IEEE Transactions on Consumer Electronics,2000,6(4):1103-1127.
[39] CHENG M M,WARRELL J,LIN W Y,et al.Efficient Salient Region Detection with Soft Image Abstraction[C]∥2013 IEEE International Conference on Computer Vision (ICCV).IEEE,2013:1529-1536.
[40] JIANG Z,DAVIS L.Submodular Salient Region Detection[C]∥Conference on Computer Vision and Pattern Recognition.IEEE,2013:2043-2050.
[41] KLEIN D A,FRINTROP S.Center-surround divergence of feature statistics for salient object detection[C]∥ IEEE International Conference on Computer Vision.2011:2214-2219.
[42] MAI L,NIU Y,LIU F.Saliency Aggregation:A Data-DrivenApproach[C]∥Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer So-ciety,2013:1131-1138.
[43] ROTHER C,KOLMOGOROV V,BLAKE A.GrabCut:interactive foreground extraction using iterated graph cuts[J].ACM Transactions on Graphics,2004,3(3):309-314.
[44] MANNAN S K,CHRISTOPHER K,MASUD H.The role ofvisual salience in directing eye movements in visual object agnosia[J].Current Biology Cb,2009,9(6):247-248.
[45] WOLFE J M,HOROWITZ T S.What Attributes Guide the Deployment of Visual Attention and How do They Do it?[J].Nature Reiview Neuroscience,2004,5(6):495-501.
[46] RUTISHAUSER U,WALTHER D,KOCH C,et al.Is bottom-up attention useful for object recognition?[C]∥Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2004:37-44.
[47] SUN J,LING H.Scale and object aware image retargeting for thumbnail browsing[C]∥2011 IEEE International Conference on Computer Vision (ICCV).IEEE,2011:1511-1518.
[48] MARCHESOTTI L,CIFARELLI C,CSURKA G.A framework for visual saliency detection with applications to image thumbnailing[C]∥IEEE International Conference on Computer Vision.IEEE International Conference on Computer Vision.2009:2232-2239.
[49] WANG Y S,TAI C L,SORKINE O,et al.Optimized scale-and-stretch for image resizing[J].ACM Transactions on Graphics,2008,7(5):32-39.
[50] ZHANG G X,CHENG M M,HU S M,et al.A Shape-Preserving Approach to Image Resizing[J].Computer Graphics Forum,2009,8(7):1897-1906.
[51] WU H,WANG Y S,FENG K C,et al.Resizing by symmetry-summarization[J].ACM Transactions on Graphics,2010,29(6):81-95.
[52] HUANG S,WANG W,ZHANG H.Retrieving images using saliency detection and graph matching[C]∥2014 IEEE International Conference on Image Processing (ICIP).IEEE,2014:3087-3091.
[53] FENG S,LANG C,LIU H,et al.Adaptive all-season image tag ranking by saliency-driven image pre-classification[J].Journal of Visual Communication & Image Representation,2013,4(7):1031-1039.
[54] PAPUSHOY A,BORS A G.Image retrieval based on query by saliency content[J].Digital Signal Processing,2015,6:156-173.
[55] HUANG J,YANG X,ZHANG R,et al.Re-ranking image search results by multiscale visual saliency model[C]∥ IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.IEEE,2010:1-4.
[56] WANG B,ZHANG X,WANG M,et al.Saliency distinguishing and applications to semantics extraction and retrieval of natural image[C]∥2010 International Conference on Machine Learning and Cybernetics (ICMLC).IEEE,2010:802-807.
[57] GIOUVANAKIS E,KOTROPOULOS C.Saliency map drivenimage retrieval combining the bag-of-words model and PLSA[C]∥2014 19th International Conference on Digital Signal Proces-sing (DSP).IEEE,2014:280-285.
[58] HUANG J,YANG X,ZHANG R,et al.Integrating Visual Saliency and Consistency for Re-Ranking Image Search Results[C]∥2010 17th IEEE International Conference on Image Proces-sing (ICIP).2010:653-661.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!