Computer Science ›› 2024, Vol. 51 ›› Issue (5): 143-150.doi: 10.11896/jsjkx.230100132

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Salient Object Detection Method Based on Multi-scale Visual Perception Feature Fusion

WU Xiaoqin1, ZHOU Wenjun1,2, ZUO Chenglin2, WANG Yifan1, PENG Bo1   

  1. 1 School of Computer Science,Southwest Petroleum University,Chendu 610500,China
    2 Key Laboratory of Icing and Anti/De-icing,China Aerodynamics Research and Development Center,Mianyang,Sichuan 621000,China
  • Received:2023-01-30 Revised:2023-06-29 Online:2024-05-15 Published:2024-05-08
  • About author:WU Xiaoqin,born in 1997,postgra-duate,is a member of CCF(No.N7647G).Her main research interests include compu-ter vision and salient object detection.
    ZHOU Wenjun,born in 1990,Ph.D,assistant professor,master supervisor,is a member of CCF(No.G0634M).His main research interests include compu-ter vision,image perception and understanding.
  • Supported by:
    Key Laboratory of Icing and Anti/De-icing of CARDC(IADL20210203) and Natural Science Foundation of Sichuan Province(2023NSFSC0504,2023NSFSC1393).

Abstract: Salient object detection has important theoretical research significance and practical application value,and has played an important role in many computer vision applications,such as visual tracking,image segmentation and object recognition.How-ever,the unknown categories and variable scales of salient objects in natural environments are still a major challenge for salient object detection,which affects the detection results.Therefore,this paper proposes a salient object detection method based on multi-scale visual perception feature fusion.First,based on the characteristics of visual perception,multiple perceptual features are designed and extracted.Second,each perceptual feature adopts a multi-scale adaptive method to obtain feature saliency maps.Finally,each salient feature map is fused to obtain the final salient object.According to the characteristics of different image perception features,the proposed method adaptively extracts feature salient objects,and can adapt to changing detection objects and complex detection environments.Experimental results show that this method can effectively detect salient objects of unknown categories and different scales under the background interference of natural environment.

Key words: Visual perceptual features, Salient object detection, Multi-feature fusion, Image segmentation, Multi-scale sampling

CLC Number: 

  • TP391
[1]BORJI A,CHENG M M,HOU Q,et al.Salient object detec-tion:A survey [J].Computational Visual Media,2019,5(2):117-150.
[2]ULLAH I,JIAN M,HUSSAIN S,et al.A brief survey of visual saliency detection [J].Multimedia Tools and Applications,2020,79(45):34605-34645.
[3]ITTI L,KOCH C,NIEBUR E.A model of saliency-based visual attention for rapid scene analysis [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259.
[4]LOU J,WANG H,CHEN L,et al.Exploiting color name space for salient object detection [J].Multimedia Tools and Applications,2020,79(15):10873-10897.
[5]WANG L,LU H,RUAN X,et al.Deep networks for saliency detection via local estimation and global search [C]//Procee-dings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:3183-3192.
[6]WU Z,SU L,HUANG Q.Cascaded partial decoder for fast and accurate salient object detection [C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:3907-3916.
[7]LIU J J,HOU Q,CHENG M M,et al.A simple pooling-based design for real-time salient object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:3917-3926.
[8]CHEN Z,XU Q,CONG R,et al.Global context-aware progres-sive aggregation network for salient object detection[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:10599-10606.
[9]YE X K,MA C Y,CHEN X W,et al.Global Attention-Based Multi-scale Salient Object Detection Network [J].Computer Applications and Software,2022,39(2):167-173.
[10]朱凯俊.基于改进的 FCM 算法对图像分割的研究和应用[J].重庆工商大学学报(自然科学版),2022,39(5):24-33.
[11]HE Y,XIANG S,ZHOU W,et al.A novel contrast operator for robust object searching [C]//2021 17th International Confe-rence on Computational Intelligence and Security(CIS).IEEE,2021:309-313.
[12]MITTAL A,MOORTHY A K,BOVIK A C.No-referenceimage quality assessment in the spatial domain [J].IEEE Tran-sactions on Image Processing,2012,21(12):4695-4708.
[13]ZHU C,LI G,WANG W,et al.An innovative salient object detection using center-dark channel prior[C]//Proceedings of the IEEE International Conference on Computer Vision Workshops.2017:1509-1515.
[14]HE K,SUN J,TANG X.Single image haze removal using dark channel prior [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,33(12):2341-2353.
[15]ACHANTA R,SHAJI A,SMITH K,et al.SLIC superpixelscompared to state-of-the-art superpixel methods [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(11):2274-2282.
[16]CHENG M M,MITRA N J,HUANG X,et al.Global contrast based salient region detection [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2014,37(3):569-582.
[17]BORJI A,CHENG M M,JIANG H,et al.Salient object detection:A benchmark [J].IEEE Transactions on Image Proces-sing,2015,24(12):5706-5722.
[18]YAN Q,XU L,SHI J,et al.Hierarchical saliency detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2013:1155-1162.
[19]ACHANTA R,SÜSSTRUNK S.Saliency detection using maximum symmetric surround [C]//2010 IEEE International Conference on Image Processing.IEEE,2010:2653-2656.
[20]ERDEM E,ERDEM A.Visual saliency estimation by nonlinear-ly integrating features using region covariances [J].Journal of Vision,2013,13(4):1-20.
[21]YANG C,ZHANG L,LU H.Graph-regularized saliency detection with convex-hull-based center prior [J].IEEE Signal Processing Letters,2013,20(7):637-640.
[22]MARGOLIN R,TAL A,ZELNIK-MANOR L.What makes a patch distinct? [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2013:1139-1146.
[23]FANG S,LI J,TIAN Y,et al.Learning discriminative subspaces on random contrasts for image saliency analysis [J].IEEE Transactions on Neural Networks and Learning Systems,2016,28(5):1095-1108.
[24]LIU G H,YANG J Y.Exploiting color volume and color diffe-rence for salient region detection [J].IEEE Transactions on Image Processing,2018,28(1):6-16.
[25]LI W,YANG X,LI C,et al.Fast visual saliency based on multi-scale difference of Gaussians fusion in frequency domain [J].IET Image Processing,2020,14(16):4039-4048.
[26]QIN X,ZHANG Z,HUANG C,et al.Basnet:Boundary-awaresalient object detection [C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:7479-7489.
[1] SHAN Xinxin, LI Kai, WEN Ying. Medical Image Segmentation Network Integrating Full-scale Feature Fusion and RNN with Attention [J]. Computer Science, 2024, 51(5): 100-107.
[2] BAI Xuefei, SHEN Wucheng, WANG Wenjian. Salient Object Detection Based on Feature Attention Purification [J]. Computer Science, 2024, 51(5): 125-133.
[3] LIU Zeyu, LIU Jianwei. Video and Image Salient Object Detection Based on Multi-task Learning [J]. Computer Science, 2024, 51(4): 217-228.
[4] HUANG Wenke, TENG Fei, WANG Zidan, FENG Li. Image Segmentation Based on Deep Learning:A Survey [J]. Computer Science, 2024, 51(2): 107-116.
[5] ZHU Ye, HAO Yingguang, WANG Hongyu. Deep Learning Based Salient Object Detection in Infrared Video [J]. Computer Science, 2023, 50(9): 227-234.
[6] QI Xuanlong, CHEN Hongyang, ZHAO Wenbing, ZHAO Di, GAO Jingyang. Study on BGA Packaging Void Rate Detection Based on Active Learning and U-Net++ Segmentation [J]. Computer Science, 2023, 50(6A): 220200092-6.
[7] LIU Yao, GUAN Lihe. Superpixel Segmentation Iterative Algorithm Based on Ball-k-means Clustering [J]. Computer Science, 2023, 50(6A): 220600114-7.
[8] YANG Jingyi, LI Fang, KANG Xiaodong, WANG Xiaotian, LIU Hanqing, HAN Junling. Ultrasonic Image Segmentation Based on SegFormer [J]. Computer Science, 2023, 50(6A): 220400273-6.
[9] BAI Xuefei, MA Yanan, WANG Wenjian. Segmentation Method of Edge-guided Breast Ultrasound Images Based on Feature Fusion [J]. Computer Science, 2023, 50(3): 199-207.
[10] CHEN Luoxuan, LIN Chengchuang, ZHENG Zhaoliang, MO Zefeng, HUANG Xinyi, ZHAO Gansen. Review of Transformer in Computer Vision [J]. Computer Science, 2023, 50(12): 130-147.
[11] CHEN Hui, PENG Li. Feature Fusion and Boundary Correction Network for Salient Object Detection [J]. Computer Science, 2023, 50(12): 166-174.
[12] SUN Kaixin, LIU Bin, SU Shuguang. Medical Microscopic Image Segmentation Model Based on CNN Structure and Swin Transformer [J]. Computer Science, 2023, 50(11A): 230200119-8.
[13] JIANG Haotian, WANG Qizhi, HUANG Yanglin, ZHANG Yaqin andHU Kai. Medical Image Segmentation Based on Multi-scale Edge Guidance [J]. Computer Science, 2023, 50(11A): 220900059-7.
[14] MA Weiqi, YUAN Jiabin, ZHA Keke, FAN Lili. Onboard Rock Detection Algorithm Based on Spiking Neural Network [J]. Computer Science, 2023, 50(1): 98-104.
[15] YU Shu-hao, ZHOU Hui, YE Chun-yang, WANG Tai-zheng. SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion [J]. Computer Science, 2022, 49(6A): 256-260.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!