基于超像素匹配的图像协同显著性检测

doi:10.11896/j.issn.1002-137X.2017.11.048

摘要/Abstract

摘要： 为了快速有效地完成多图像的协同显著性检测,提出了一种基于超像素匹配的检测模型。首先针对一般单个超像素特征匹配效果较差的问题,提出一种基于Hausdorff距离的邻域超像素集匹配算法来进行图像间超像素的精确匹配；然后构建图像内和图像间的双层元胞自动机模型,进行多幅图像之间的显著性传播,从而有效地检测出协同显著性。在公开的测试数据集上的实验结果表明,所提算法的检测精度和检测效率优于目前的主流算法,且具有较强的鲁棒性。

关键词: 协同显著性检测,Hausdorff距离,超像素匹配,元胞自动机,显著性传播

Abstract: To effectively address the issue of multi-scene co-saliency detection,we proposed a novel model based on superpixel matching and cellular automata.First of all,we introduced an adjacent superpixel sets matching algorithm based on Hausdorff distance to achieve exact matching between image supperpixels.Comparing to the traditional superpixel matching algorithm,the new algorithm greatly improves the matching accuracy.In addition,we further proposed the 2-layer cellular automata via intra image and inter images to carry out the significant propagation of multiple images,thus exploit the intrinsic relevance of similar regions through interactions with neighbors in multi-scene.Experimental results demonstrate that our model outperforms state-of-the-art methods.Furthermore,the proposed methods is efficient and robust.

Key words: Co-saliency detection,Hausdorff distance,Superpixel matching,Cellular automata,Saliency propagation

张兆丰,吴泽民,姜青竹,杜麟,胡磊. 基于超像素匹配的图像协同显著性检测[J]. 计算机科学, 2017, 44(11): 314-319. https://doi.org/10.11896/j.issn.1002-137X.2017.11.048

ZHANG Zhao-feng, WU Ze-min, JIANG Qing-zhu, DU Lin and HU Lei. Co-saliency Detection via Superpixel Matching[J]. Computer Science, 2017, 44(11): 314-319. https://doi.org/10.11896/j.issn.1002-137X.2017.11.048

参考文献

[1] CHENG M,ZHANG G,MITRA N,et al.Global contrast based salient region detection[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Colorado Springs,USA,2011:409-416.
[2] PERAZZI F,KRAHENBUHL P,PRITCH Y,et al.Saliency filters:contrast based filtering for salient region detection[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Rhode Island,USA,2012:733-740.
[3] YANG C,ZHANG L,LU H,et al.Saliency detection via graph-based manifold ranking[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Portland,USA,2013:3166-3173.
[4] ZHU W,LIANG S,WEI Y,et al.Saliency optimization from robust background detection[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Columbus,USA,2014:2814-2821.
[5] QIN Y,LU H,XU Y,et al.Saliency detection via cellular au-tomata[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Boston,USA,2015:111-119.
[6] LI H,NGAN K N.A co-saliency model of image pairs[J].IEEETransactions on Image Processing,2011,20(12):3365-3375.
[7] FU H,CAO X,TU Z.Cluster-based co-saliency detection[J].IEEE Transactions on Image Processing,2013,22(10):3766-3778.
[8] LIU Z,ZOU W,LI L,et al.Co-saliency detection based on hie-rarchical segmentation[J].IEEE Signal Processing Letters,2014,21(1):88-92.
[9] CAO X,TAO Z,ZHANG B,et al.Self-adaptively weighted co-saliency detection via rank constraint[J].IEEE Transactions on Image Processing,2014,23(9):4175-4186.
[10] ZHANG D,HAN J,LI C,et al.Co-saliency detection via looking deep and wide[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Boston,USA,2015:2994-3002.
[11] ZHANG D,MENG D,LI C,et al.A self-paced multiple-instance learning framework for co-saliency detection[C]∥IEEE Confe-rence on Computer Vision (ICCV).Santiago,Chile,2015:594-602.
[12] ACHANTA R,SHAJI A,SMITH K,et al.Slic superpixelscompared to state-of-the-art superpixel methods[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(11):2274-2281.
[13] KIM J,HAN D,TAI Y,et al.Salient region detection via high-dimensional color transform[C]∥IEEE Conference on Compu-ter Vision and Pattern Recognition (CVPR).Columbus,USA,2014:863-890.
[14] BROX T,MALIK J.Large displacement optical flow:descriptor matching in variational motion estimation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,33(3):500-513.
[15] CHANG K,LIU Y,CHEN H,et al.Fusing generic objectness and visual saliency for salient object detection[C]∥IEEE Conference on Computer Vision (ICCV).Barcelona,Spain,2011:914-921.
[16] WEI Y,WEN F,ZHU W,et al.Geodesic saliency using background priors[C]∥12th European Conference on Computer Vision (ECCV).Florence,Italy,2012:29-42.
[17] YAN Q,XU L,SHI J,et al.Hierarchical saliency detection[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Portland,USA,2013:1155-1162.
[18] MARGOLIN R,TAL A,ZELNIK-MANOR L.What makes a patch distinct?[C]∥IEEE Conference on Computer Vision and Pattern Recognition(CVPR).Portland,USA,2013:1139-1146.
[19] JIANG H,WANG J,YUAN Z,et al.Salient object detection:a discriminative regional feature integration approach[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Portland,USA,2013:2083-2090.
[20] JIANG B,ZHANG L,LU H,et al.Saliency detection via absorbing Markov chain[C]∥IEEE Conference on Computer Vision (ICCV).Sydney,Australia,2013:1665-1672.
[21] LI X,LU H,ZHANG L,et al.Saliency detection via dense and sparse reconstruction[C]∥IEEE Conference on Computer Vision (ICCV).Sydney,Australia,2013:2976-2983.
[22] CHENG M,WARRELL J,LIN W,et al.Efficient salient region detection with soft image abstraction[C]∥IEEE Conference on Computer Vision (ICCV).Sydney,Australia,2013:1529-1536.
[23] JIANG P,LING H,YU J,et al.Salient region detection byUFO:uniqueness,focusness and objectness[C]∥IEEE Confe-rence on Computer Vision (ICCV).Sydney,Australia,2013:1976-1983.
[24] LIU R,CAO J,LIN Z,et al.Adaptive partial differential equation learning for visual saliency detection[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Columbus,USA,2014:3866-3873.
[25] LU S,MAHADEVAN V,VASCONCELOS N.Learning opti-mal seeds for diffusion-based salient object detection[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Columbus,USA,2014:2790-2797.
[26] LI N,YE J,JI Y,et al.Saliency detection on light field[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Columbus,USA,2014:3866-3873.
[27] VIG E,DORR M,COX D.Large-scale optimization of hierarchical features for saliency prediction in natural images [C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Columbus,USA,2014:2798-2805.
[28] LI Y,HOU X,KOCH C.The secret of salient object segmentation[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Columbus,USA,2014:280-287.
[29] MARGOLIN R,ZELNIK-MANOR L,TAL A.How to evaluate foreground maps?[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Columbus,USA,2014:248-255.
[30] BATRA D,KOWDLE A,PARIKH D,et al.Interactively co-segmentating topically related images with intelligent scribble guidance[J].International Journal of Computer Vision,2011,93(3):273-292.
[31] BORJI A,CHENG M,JIANG H,et al.Salient object detection:a benchmark[J].IEEE Transactions on Image Processing,2015,24(12):5706-5722.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed