Computer Science ›› 2019, Vol. 46 ›› Issue (3): 48-52.doi: 10.11896/j.issn.1002-137X.2019.03.006

• Surveys • Previous Articles     Next Articles

Review of Bottom-up Salient Object Detection

WU Jia-ying1,YANG Sai1,2,DU Jun1,LIN Hong-da1   

  1. (School of Electrical Engineering,Nantong University,Nantong,Jiangsu 226019,China)1
    (Nantong Research Institute for Advanced Communication Technologies,Nantong,Jiangsu 226019,China)2
  • Received:2018-03-13 Revised:2018-07-12 Online:2019-03-15 Published:2019-03-22

Abstract: This paper reviewed the current development status at home and abroad in the field of salient object detection.Firstly,this paper introduced the research background and development process of salient object detection.Then,aiming at the difference of the features used by each saliency model,it summarized the saliency calculation from two aspects of hand-crafted features and deep learning features.While the saliency calculation based on hand-crafted features are addressed,it is further classified into the following three subcategories,i.e.the saliency calculation based on contrast prior,the saliency calculation based on foreground prior,and the saliency calculation based on back ground prior.Meanwhile,this paper elaborated the basic ideas of saliency modeling in each subcategory.Finally,it discussed the problems to be solved and further research directions of salient object detection.

Key words: Salient object detection, Saliency prior, Deep learning, Fusion of saliency maps

CLC Number: 

  • TP391
[1] ITTI L,KOCH C,NIEBUR.A model of saliency-based visualattention for rapid scene analysis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259.
[2] MA Y F,ZHANG H J.Contrast-based image attention analysis by using fuzzy growing[C]∥Proceedings of the 11th ACM Conference on Multimedia.New York:ACM,2003:374-381.
[3] ACHANTA R,ESTRADA F,WILS P,et al.Salient region detection and segmentation[C]∥Proceedings of the 6th International Conference on Computer Vision Systems.Berlin:Springer-Verlag,2008:66-75.
[4] GOFERMAN S,ZELNIK-MAMOR L,TAL A.Context-aware saliency detection[C]∥Proceedings of the 23rd International Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2010:2376-2383.
[5] ZHAI Y,SHAH M.Visual attention detection in video se-quences using spatiotemporal cues[C]∥Proceedings of the 14th ACM Conference on Multimedia.New York:ACM Press,2006:815-824.
[6] CHENG M M,ZHANG G X,MITRA N J,et al.Global contrast based salient region detection[C]∥Proceedings of the 24th International Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2011:409-416.
[7] ACHANTA R,HEMAMI S,ESTRADA F,et al.Frequency-tuned salient region detection[C]∥Proceedings of the 22nd Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2009:1597-1604.
[8] JIANG H Z,WANG J D,YUAN Z J,et al.Automatic salient object segmentation based on context and shape prior[C]∥Proceedings of the 14th British Machine Vision Conference.Norwich,UK:British Machine Vision Association,2011:111-122.
[9] YAN Q,XU L,SHI J P,JIA J Y.Hierarchical Saliency Detection[C]∥ Proceedings of the 26th International Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2013:1155-1162.
[10] TONG N,LU H C,ZHANG L H,et al.Saliency detection with Multi-Scale Superpixels [J].IEEE Signal Processing Letters,2014,21(9):1035-1039.
[11] XIE Y L,LU H C,YANG M H.Bayesian saliency via low and mid level cues[J].IEEE Transactions on Image Processing,2013,22(5):1689-1698.
[12] CHANG K Y,LIU T L,CHEN H T,et al.Fusing Generic Objectness and Visual Saliency for Salient Object Detection[C]∥Proceedings of the 13th International Conference on Computer Vision.Los Alamitos:IEEE,2011.
[13] YANG S,ZHAO C X,XU W.A novel salient object detection method using bag-of-features[J].Acta Automatica Sinica,2016,42(8):1259-1273.(in Chinese)杨赛,赵春霞,徐威.一种基于词袋模型的新的显著性目标检测算法[J].自动化学报,2016,42(8):1259-1273.
[14] WEI Y,WEN F,ZHU W,et al.Geodesic saliency using background priors[C]∥Proceedings of the 12th EuropeanConfe-rence on Computer Vision.Berlin:Springer-Verlag,2012:29-42.
[15] ZHU W J,LIANG S,WEI Y C,et al.Saliency optimization from robust background detection[C]∥Proceedings of the 27th International Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2014:2814-2821.
[16] LU H C,LI X H,ZHANG L H,et al.Dense and sparse reconstruction error Based saliency descriptor[J].IEEE Transaction on Image Processing,2016,25(4):1592-1603.
[17] TONG N,LU H C,ZHANG L H,et al.Salient object detection via global and local cues[J].Pattern Recognition,2015,48(10):3258-3267.
[18] ZHANG L H,YANG C,LU H C,et al.Ranking saliency[J].IEEE Transaction on Pattern Analysis and Machine Intelligence,2017,39(9):1-15.
[19] JIANG P,VASCONCELOS N,PENG J L.Generic promotion of diffusion-based salient object detection[C]∥Proceedings of the 15th International Conference on Computer Vision.Los Alamitos:IEEE Computer Society,2015:217-225.
[20] AYTEKINA C,LOSIFIDIS A,KIRANYAZ S,et al.Learning graph affinities for spectral graph-based salient object detection[J].Pattern Recognition,2017,64(4):159-167.
[21] JIANG B W,ZHANG L H,LU H C,et al.Saliency detection via Absorbing Markov Chain[C]∥Proceedings of the 14th International Conference on Computer Vision.Los Alamitos:IEEE Computer Society,2013:1665-1672.
[22] SUN J,LU H,LIU X.Saliency Region Detection based onMarkov Absorption Probabilities.IEEE Trans Image Process,2015,24(5):1639-1649.
[23] JIANG H Z,YUAN Z J,CHENG M M,et al.Salient object detection:a discriminative regional feature integration approach[C]∥Proceedings of the 26th International Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2013:2083-2090.
[24] LU H C,TONG N,ZHANG X N,et al.Co-bootstrapping sa-liency.IEEE Transactions on Image Processing,2017,26(1):414-425.
[25] LI S,LU H C,ZHE L,et al.Adaptive metric learning for sa-liency detection[J].IEEE Transactions on Image Processing,2015,24(11):3321-3331.
[26] AYTEKINA C,LOSIFIDIS A,KIRANYAZ S,Gabbouj M.Probabilistic saliency estimation[J].Pattern Recognition,2018,74(2):359-372.
[27] LI G,YU Y.Visual saliency based on multiscale deep features[C]∥Proceedings of the 28th International Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2015:5455-5463.
[28] ZHAO R,OUYANG W,LI H,et al.Saliency detection by multi-context deep learning[C]∥Proceedings of the 28th InternationalConference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2015:1265-1274.
[29] WANG L,LU H,RUAN X,et al.Deep networks for saliency detection via local estimation and global search[C]∥Procee-dings of the 28th International Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2015:3183-3192.
[30] CHEN J,CHEN J,LU H,et al.CNN for saliency detection with low-level feature integration[J].Neurocomputing,2017,226(C):212-220.
[31] LI G,YU Y.Deep contrast learning for salient object detection[C]∥Proceedings of the 29th International Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2016:478-487.
[32] HU P,SHUAI B,LIU J,et al.Deep level sets for salient objectdetection[C]∥Proceedings of the 30th International Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society,2017.
[33] ZHANG P,WANG D,LU H C,et al.Learning uncertain convolutional features for accurate saliency detection[C]∥ Procee-dings of the 16th International Conference on Computer Vision.Los Alamitos:IEEE Computer Society,2017:1665-1672.
[34] LEE G,TAI Y W,KIM J.ELD-Net:An efficient deep learning architecture for accurate saliency detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,PP(99):1.
[1] ZHOU Yan, ZENG Fan-zhi, WU Chen, LUO Yue, LIU Zi-qin. 3D Shape Feature Extraction Method Based on Deep Learning [J]. Computer Science, 2019, 46(9): 47-58.
[2] MA Lu, PEI Wei, ZHU Yong-ying, WANG Chun-li, WANG Peng-qian. Fall Action Recognition Based on Deep Learning [J]. Computer Science, 2019, 46(9): 106-112.
[3] LI Qing-hua, LI Cui-ping, ZHANG Jing, CHEN Hong, WANG Shao-qing. Survey of Compressed Deep Neural Network [J]. Computer Science, 2019, 46(9): 1-14.
[4] WANG Yan-ran, CHEN Qing-liang, WU Jun-jun. Research on Image Semantic Segmentation for Complex Environments [J]. Computer Science, 2019, 46(9): 36-46.
[5] SUN Zhong-feng, WANG Jing. RCNN-BGRU-HN Network Model for Aspect-based Sentiment Analysis [J]. Computer Science, 2019, 46(9): 223-228.
[6] MIAO Yong-wei, LI Gao-yi, BAO Chen, ZHANG Xu-dong, PENG Si-long. Image Localized Style Transfer Based on Convolutional Neural Network [J]. Computer Science, 2019, 46(9): 259-264.
[7] DENG Cun-bin, YU Hui-qun, FAN Gui-sheng. Integrating Dynamic Collaborative Filtering and Deep Learning for Recommendation [J]. Computer Science, 2019, 46(8): 28-34.
[8] DU Wei, DING Shi-fei. Overview on Multi-agent Reinforcement Learning [J]. Computer Science, 2019, 46(8): 1-8.
[9] GUO Xu, ZHU Jing-hua. Deep Neural Network Recommendation Model Based on User Vectorization Representation and Attention Mechanism [J]. Computer Science, 2019, 46(8): 111-115.
[10] ZHANG Yi-jie, LI Pei-feng, ZHU Qiao-ming. Event Temporal Relation Classification Method Based on Self-attention Mechanism [J]. Computer Science, 2019, 46(8): 244-248.
[11] LI Zhou-jun,WANG Chang-bao. Survey on Deep-learning-based Machine Reading Comprehension [J]. Computer Science, 2019, 46(7): 7-12.
[12] ZHANG Lin-na,CHEN Jian-qiang,CHEN Xiao-ling,CEN Yi-gang,KAN Shi-chao. Lightweight SSD Network for Real-time Object Detection in Automotive Videos [J]. Computer Science, 2019, 46(7): 233-237.
[13] LI Jian, YANG Xiang-ru, HE Bin. Geometric Features Matching with Deep Learning [J]. Computer Science, 2019, 46(7): 274-279.
[14] LIU Meng-juan,ZENG Gui-chuan,YUE Wei,QIU Li-zhou,WANG Jia-chang. Review on Click-through Rate Prediction Models for Display Advertising [J]. Computer Science, 2019, 46(7): 38-49.
[15] CHEN Si-wen, LIU Yu-jiang, LIU Dong, SU Chen, ZHAO Di, QIAN Lin-xue, ZHANG Pei-heng. AlexNet Model and Adaptive Contrast Enhancement Based UltrasoundImaging Classification [J]. Computer Science, 2019, 46(6A): 146-152.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] LI Bai-shen, LI Ling-zhi, SUN Yong and ZHU Yan-qin. Intranet Defense Algorithm Based on Pseudo Boosting Decision Tree[J]. Computer Science, 2018, 45(4): 157 -162 .
[2] WANG Huan, ZHANG Yun-feng and ZHANG Yan. Rapid Decision Method for Repairing Sequence Based on CFDs[J]. Computer Science, 2018, 45(3): 311 -316 .
[3] LIU Qin. Study on Data Quality Based on Constraint in Computer Forensics[J]. Computer Science, 2018, 45(4): 169 -172 .
[4] ZHOU Yan-ping and YE Qiao-lin. L1-norm Distance Based Least Squares Twin Support Vector Machine[J]. Computer Science, 2018, 45(4): 100 -105, 130 .
[5] LIU Bo-yi, TANG Xiang-yan and CHENG Jie-ren. Recognition Method for Corn Borer Based on Templates Matching in Muliple Growth Periods[J]. Computer Science, 2018, 45(4): 106 -111, 142 .
[6] CUI Qiong, LI Jian-hua, WANG Hong and NAN Ming-li. Resilience Analysis Model of Networked Command Information System Based on Node Repairability[J]. Computer Science, 2018, 45(4): 117 -121, 136 .
[7] LI Shan and RAO Wen-bi. Video-based Detection of Human Motion Area in Mine[J]. Computer Science, 2018, 45(4): 291 -295 .
[8] LIAO Xing, YUAN Jing-ling and CHEN Min-cheng. Parallel PSO Container Packing Algorithm with Adaptive Weight[J]. Computer Science, 2018, 45(3): 231 -234, 273 .
[9] HAN Kui-kui, XIE Zai-peng and LV Xin. Fog Computing Task Scheduling Strategy Based on Improved Genetic Algorithm[J]. Computer Science, 2018, 45(4): 137 -142 .
[10] QU Zhong and ZHAO Cong-mei. Anti-occlusion Adaptive-scale Object Tracking Algorithm[J]. Computer Science, 2018, 45(4): 296 -300 .