计算机科学 ›› 2018, Vol. 45 ›› Issue (10): 261-266.doi: 10.11896/j.issn.1002-137X.2018.10.048

• 图形图像与模式识别 • 上一篇    下一篇

融入频域信息聚焦特征的显著性目标检测算法

袁小艳1, 王安志2, 王明辉3   

  1. 四川文理学院智能制造学院 四川 达州635000 1
    西南民族大学计算机科学与技术学院 成都610041 2
    四川大学计算机学院 成都610064 3
  • 收稿日期:2017-09-02 出版日期:2018-11-05 发布日期:2018-11-05
  • 作者简介:袁小艳(1982-),女,硕士,讲师,CCF会员,主要研究方向为计算机视觉、机器学习和个性化云服务,E-mail:214381870@qq.com;王安志(1986-),男,博士生,主要研究方向为计算机视觉、机器学习,E-mail:andyscu@163.com(通信作者);王明辉(1971-),男,教授,博士生导师,主要研究方向为图象图形处理、信息融合、医学大数据。
  • 基金资助:
    国家重点研究与发展计划(2016YFB0700802,2016YFB0800600),国家海洋局海洋遥感工程技术研究中心创新青年项目(2015001),四川省教育厅一般项目(18ZB0509),四川文理学院智能制造产业技术开发研究专项项目(2017ZZ006Y)资助

Saliency Object Detection Algorithm Integrating Focusness Feature of Frequency Domain Information

YUAN Xiao-yan1, WANG An-zhi2, WANG Ming-hui3   

  1. School of Intelligent Manufacturing,Sichuan University of Arts and Science,Dazhou,Sichuan 635000,China 1
    School of Computer Science and Technology,Southwest Minzu University,Chengdu 610041,China 2
    College of Computer Science,Sichuan University,Chengdu 610064,China 3
  • Received:2017-09-02 Online:2018-11-05 Published:2018-11-05

摘要: 由于视觉注意预测能够快速、准确地定位图像中的显著区域,因此将视觉注意中的频域信息融入显著性目标检测中,从而有效地在复杂场景中检测显著性目标。首先,采用改进的频域检测方法对图像进行视觉注意预测,将该频域信息融入Focusness特征中计算得到频域信息聚焦特征,并将此特征与颜色特征进行融合得到前景显著图。然后,对RBD背景进行优化,得到背景显著图。最后,对前景显著图、背景显著图进行融合。在ESSCD,DUT-OMON两个具有挑战性的数据集上进行了大量实验,并采用PR_Curve,F-Measure,MAE对结果进行了评估,结果表明,所提出的方法要优于6种对比方法(HFT,PQFT,HDCT,UFO,DSR和RBD),并且能够处理复杂场景的图像。

关键词: Focusness, 背景, 边框连接性, 频域信息, 显著性

Abstract: Since visual attention prediction can locate the salient area of image quickly and accurately,in this paper,the frequency domain information of visual attention was integrated into the saliency object detection,to detect the saliency object effectively in the complex scene.Firstly,the improved frequency domain detection method is used to predict the visual attention of image,and the frequency domain information is blended into Focusness feature to calculate the frequency domain information focusness feature,which is combined with the color feature to generate the foreground sa-liency map.Next,the RBD background is optimized to generate the background saliency map.Finally,the foreground saliency map and background sa-liency map are fused to generate saliency map.A large number of experiments were carried out on two challenging datasets(ESSCD and DUT-OMON),and the results were evaluated by PR curve,F-Measure and MAE.Experimental results show that the proposed method is better than HFT,PQFT,HDCT,UFO,DSR and RBD,and it can deal with the images with complex scenes.

Key words: Background, Boundary connectivity, Focusness, Frequency domain information, Saliency

中图分类号: 

  • TP301.6
[1]SHANG W L,JIAN L H,YAN M C.Saliency Detection Based on Spatio-Frequency Information[C]∥IEEE International Conference on Communication Software and Networks.2016:642-646.
[2]BI F K,CHEN H,SHI H,et al.Identifying and Tracking Speci- fic Building Areas in Airborne Remote Sensing Video with Complicated Scenes[J].Journal of Electronics,2016,44(6):1394-1399.(in Chinese)
毕福昆,陈禾,师皓,等.机载复杂遥感场景下特定建筑区检测跟踪算法[J].电子学报,2016,44(6):1394-1399.
[3]GAO Z Y,TANG W F,HE L J.Moving object detection with moving camera based on motion saliency[J].Journal of Compu-ters Application,2016,36(6):1692-1698.(in Chinese)
高智勇,唐文峰,贺良杰.基于运动显著性的移动镜头下的运动目标检测[J].计算机应用,2016,36(6):1692-1698.
[4]BORJI A,ITTI L.Scene classification with a sparse set of sa- lient regions[C]∥IEEE International Conference on Robotics & Automation.2011:1902-1908.
[5]ZHOU J B,REN Y F,YAN Y Y.Unsupervised Image Segmentation Based on Saliency Detection[J].Computer Science,2015,42(8):52-56.(in Chinese)
周静波,任永峰,严云洋.基于视觉显著性的非监督图像分割[J].计算机科学,2015,42(8):52-56.
[6]LI S Q,ZENG C,LIU S P,et al.Merging fixation for saliency detection in a multilayer graph[J].Neurocomputing,2017,230(C):173-183.
[7]WANG Z S,LI B X.A two-stage approach to saliency detection in images[C]∥International Conference on Acoustics,Speech and Signal Processing.IEEE,2008:965-968.
[8]HOU X,ZHANG L.Saliency detection:A spectral residual approach[C]∥Conference on Computer Vision And PatternRecognition.IEEE,2007:1-8.
[9]MISHRA A,ALOIMONOS Y,FAH C L.Active segmentation with fixation[C]∥IEEE Proceedings of the 12th International Conference on Computer Vision.2009:468-475.
[10]LI J,LEVINE M D,AN X J,et al.Visual Saliency Based on Scale-Space Analysis in the Frequency Domain[J].IEEE Tran-sactions on Pattern Analysis and Machine Intelligence,2013,35(4):996-1010.
[11]JIANG P,LING H B,YU J Y,et al.Salient Region Detection by UFO:Uniqueness,Focusness and Objectness[C]∥Proceedings of IEEE International Conference on Computer Vision.2013:1976-1983.
[12]GUO C L,MA Q,ZHANG L M.Spatio-temporal Saliency Detection Using Phase Spectrum of Quaternion Fourier Transform[C]∥Proceedings of IEEE Computer Vision and Pattern Recognition.Anchorage,AK,2008:1-8.
[13]ZHU W J,LIANG S,WEI Y C,et al.Saliency Optimization from Robust Background Detection[C]∥Proceedings of IEEE Computer Vision and Pattern Recognition.2014:2814-2821.
[14]WANG J P,LU H C,LI X H,et al.Saliency detection via background and foreground seed selection[J].Neurocomputing,2015,152(C):359-368.
[15]SUN X L,ZHU Z S,LIU X L,et al.Frequency-spatial domain based salient region detection[J].Optik,2015,126(9-10):942-949.
[16]LIU S W,HU J L.Visual saliency based on frequency domain analysis and spatial information[J].Multimed Tools & Applications,2016,75(23):1-13.
[17]ITTI L,KOCH C,NIEBUR E.A Model of Saliency-Based Visual Attention for Rapid Scene Analysis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259.
[18]ZHAO B,DELP E J.Visual Saliency Models Based on Spectrum Processing[C]∥Proceedings of IEEE Winter Conference on Applications of Computer Vision.Waikoloa,HI,2015:976-981.
[19]KIM J,HAN D,TAI Y W,et al.Salient Region Detection via High-Dimensional Color Transform[C]∥IEEE Computer Vision and Pattern Recognition.2014:883-890.
[20]JIANG H Z,WANG J D,YUAN Z J,et al.Automatic Salient Object Segmentation Based on Context and Shape[C]∥British Machine Vision Conference.2011:1-12.
[21]MARTIN D R,FOWLKES C C,MALIK J.Learning to detect natural image boundaries using local brightness,color,and texture cues[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2004,26(5):530-549.
[22]QIN Y,LU H,XU Y,et al.Saliency detection via Cellular Automata[C]∥Proceedings of IEEE Computer Vision and Pattern Recognition.IEEE,2015:110-119.
[23]CHUAN Y,HE L Z,CHUAN H L,et al.Saliency Detection Via Graph-Based Manifold Ranking[C]∥IEEE Computer Vision and Pattern Recognition.2013:3166-3173.
[1] 辛元雪, 史朋飞, 薛瑞阳.
基于区域提取与改进 LBP 特征的运动目标检测
Moving Object Detection Based on Region Extraction and Improved LBP Features
计算机科学, 2021, 48(7): 233-237. https://doi.org/10.11896/jsjkx.200600131
[2] 刘翔宇, 蹇木伟, 鲁祥伟, 何为凯, 李晓峰, 尹义龙.
基于眼动点视觉先验与边缘优化的显著性检测
Saliency Detection Based on Eye Fixation Prediction and Boundary Optimization
计算机科学, 2021, 48(6A): 107-112. https://doi.org/10.11896/jsjkx.201100116
[3] 潘明远, 宋慧慧, 张开华, 刘青山.
学习全局引导渐进特征聚合轻量级网络的显著性目标检测
Learning Global Guided Progressive Feature Aggregation Lightweight Network for Salient Object Detection
计算机科学, 2021, 48(6): 103-109. https://doi.org/10.11896/jsjkx.200600068
[4] 袁星星, 吴秦.
基于显著性特征和角度信息的遥感图像目标检测
Object Detection in Remote Sensing Images Based on Saliency Feature and Angle Information
计算机科学, 2021, 48(4): 174-179. https://doi.org/10.11896/jsjkx.191200027
[5] 黄欣, 雷刚, 曹远龙, 陆明名.
基于深度学习的交互式问答研究综述
Review on Interactive Question Answering Techniques Based on Deep Learning
计算机科学, 2021, 48(12): 286-296. https://doi.org/10.11896/jsjkx.210100209
[6] 于晓明, 黄铧.
改进GAN网络在生成短视频的应用研究
Research on Application of Improved GAN Network in Generating Short Video
计算机科学, 2021, 48(11A): 625-629. https://doi.org/10.11896/jsjkx.210300114
[7] 王霞, 彭致华, 李俊余, 吴伟志.
一种基于概念可辨识矩阵的概念约简方法
Method of Concept Reduction Based on Concept Discernibility Matrix
计算机科学, 2021, 48(1): 125-130. https://doi.org/10.11896/jsjkx.200800013
[8] 王教金, 蹇木伟, 刘翔宇, 林培光, 耿蕾蕾, 崔超然, 尹义龙.
基于3D全时序卷积神经网络的视频显著性检测
Video Saliency Detection Based on 3D Full ConvLSTM Neural Network
计算机科学, 2020, 47(8): 195-201. https://doi.org/10.11896/jsjkx.190600148
[9] 袁野, 和晓歌, 朱定坤, 王富利, 谢浩然, 汪俊, 魏明强, 郭延文.
视觉图像显著性检测综述
Survey of Visual Image Saliency Detection
计算机科学, 2020, 47(7): 84-91. https://doi.org/10.11896/jsjkx.190900006
[10] 金文清, 韩芳.
一种基于音高显著性增强的主旋律提取方法
Main Melody Extraction Method Based on Saliency Enhancement
计算机科学, 2020, 47(6A): 24-28. https://doi.org/10.11896/JsJkx.191200022
[11] 刘俊琦, 李智, 张学阳.
基于视觉显著性的海面船只候选区域检测方法
Candidate Region Detection Method for Maritime Ship Based on Visual Saliency
计算机科学, 2020, 47(6A): 237-241. https://doi.org/10.11896/JsJkx.191000196
[12] 赵博, 杨明, 汤志伟, 蔡玉鑫.
基于FPGA的智能视频加速检索系统
Intelligent Video Surveillance Systems Based on FPGA
计算机科学, 2020, 47(6A): 609-611. https://doi.org/10.11896/JsJkx.190700118
[13] 刘俊琦,李智,张学阳.
可见光遥感图像海面目标检测技术综述
Review of Maritime Target Detection in Visible Bands of Optical Remote Sensing Images
计算机科学, 2020, 47(3): 116-123. https://doi.org/10.11896/jsjkx.190300102
[14] 温静, 李雨萌.
基于多尺度反卷积深度学习的显著性检测
Salient Object Detection Based on Multi-scale Deconvolution Deep Learning
计算机科学, 2020, 47(11): 179-185. https://doi.org/10.11896/jsjkx.190900008
[15] 王恰, 戚湧.
基于帧间差分和统计直方图的交通视频背景建模方法
Method for Traffic Video Background Modeling Based on Inter-frame Difference and Statistical Histogram
计算机科学, 2020, 47(10): 174-179. https://doi.org/10.11896/jsjkx.190800014
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!