计算机科学 ›› 2015, Vol. 42 ›› Issue (8): 86-89.

• 2014’江苏省人工智能学术会议 • 上一篇    下一篇

热红外与可见光视频融合的运动目标检测

张笙,严云洋,李郁峰   

  1. 淮阴工学院计算机工程学院 淮安223003;西南科技大学计算机科学与技术学院 绵阳621010,淮阴工学院计算机工程学院 淮安223003;西南科技大学计算机科学与技术学院 绵阳621010;淮安市物联网技术及应用研究重点实验室 淮安223003,西南科技大学计算机科学与技术学院 绵阳621010
  • 出版日期:2018-11-14 发布日期:2018-11-14
  • 基金资助:
    本文受教育部科学技术研究重大项目(311024),江苏省“六大人才高峰”项目(2013DZXX023),江苏省“333工程”,淮安市“533工程”,淮安市科技计划项目(HAG2013057,HAG2013059),西南科技大学研究生创新基金资助

Moving Target Detection Using Fusion of Visual and Thermal Video

ZHANG Sheng, YAN Yun-yang and LI Yu-feng   

  • Online:2018-11-14 Published:2018-11-14

摘要: 在室外环境中,可见光相机可以获取场景中丰富的纹理细节和光谱信息,但受光照变化的影响很大;而热红外相机对光照变化不敏感,但热红外成像对比度低、颜色信息缺失。为了充分利用两者的互补信息,实现运动目标的精确检测,同时提高检测的鲁棒性,提出了一种应用RGBT混合高斯模型的目标检测方法。该方法将热红外图像作为第4个分量加入到传统的混合高斯模型中,提高了算法的正检率;还引入了阴影去除算法,增强了算法的鲁棒性。实验表明,该方法比传统的混合高斯模型检测精度更高,目标更完整,同时也能较好地满足实时性的要求。

关键词: 运动目标检测,热红外视频,可见光视频,数据融合,混合高斯

Abstract: In outdoor environments,visible light camera can get rich texture and spectral information in the scene,but they are greatly influenced by illumination changes.On the contrary,thermal infrared camera is not sensitive to light and it is still able to work effectively under night.But the thermal infrared images have less color information and lower contrast.In order to make full use of the complementary information of infrared and visible light for detection target,a novel method based on Gaussian mixture model with RGBT was proposed for moving target detection more accurately and robust.This method adds the thermal infrared images as the fourth component to the conventional Gaussian mixture model to improve the positive detection rate.Meanwhile,the shadow removal algorithm is introduced to reduce the impact of shadows caused by the ambient illumination changes,so the robustness of proposed method is enhanced.Experimental results show that the suggested method not only achieves the higher detection accuracy and more complete object,but also meets the real-time requirements better compared to the conventional Gaussian mixture models.

Key words: Moving target detection,Thermal video,Visible video,Data fusion,Gaussian mixture model

[1] 张笙,李郁峰,严云洋,等.面向鲁棒视觉监控的热红外与可见光视频融合运动目标检测[J].红外技术,2013(12):773-779 Zhang Sheng,Li Yu-feng,Yan Yun-yang,et al.Moving Target Detection Using Fusion of Visual and Thermal Video for Robust Surveillance[J].Infrared Technology,2013(12):773-779
[2] Zhu Z,Huang T S.Multimodal surveillance:an introduction[C]∥Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2007).Washington DC,USA:IEEE Computer Society,2007:1-6
[3] Davis J W,Sharma V.Fusion-based background-subtractionusing contour saliency[C]∥Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Re-cognition(CVPR 2005).Washington DC,USA:IEEE Computer Society,2005:11-18
[4] Torresan H,Turgeon B,Ibarra-Castanedo C,et al.Advanced surveillance systems:combining video and thermal imagery for pedestrian detection[C]∥Defense and Security,International Society for Optics and Photonics.Bellingham,USA:SPIE,2004:506-515
[5] Snidaro L,Foresti G L,Niu R,et al.Sensor fusion for video surveillance[C]∥Proceedings of the 7th International Conference on Information Fusion.New York,USA:Electrical Engineering and Computer Science,2004:739-746
[6] Stauffer C,Grimson W E L.Learning patterns of activity using real-time tracking [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2000,22(8):747-757
[7] 黄文丽,范勇,李绘卓,等.改进的混合高斯算法[J].计算机工程与设计,2011,32(2):592-595 Huang Wei-li,Fan Yong,Li Hui-zhuo,et al.Improved Mixture Gaussian Algorithm[J].Computer Engineering and Design,2011,2(2):592-595
[8] 姚会,苏松志,王丽,等.基于改进的混合高斯模型的运动目标检测方法[J].厦门大学学报(自然科学版),2008,47(4):505-510 Yao Hui,Su Song-zhi,Wang Li,et al.Moving Object Dection Method Based on the Improved Mixture Model[J].Journal of Xiamen University(Natural Science),2008,47(4):505-510
[9] 李鸿.基于混合高斯模型的运动检测及阴影消除算法研究[D].天津:中国民航大学,2013 Li Hong.The Research of Motion Detection Based on Gaussian Mixture Model and Shadow Elimination Algorithm[D].Tianjin:Civil Aviation University of China,2013

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!