计算机科学 ›› 2019, Vol. 46 ›› Issue (6A): 182-187.

• 模式识别与图像处理 • 上一篇    下一篇

深度学习在驾驶员安全带检测中的应用

霍星1, 费志伟2, 赵峰2, 邵堃3   

  1. 合肥工业大学数学学院 合肥2300091;
    合肥工业大学软件学院 合肥2300092;
    合肥工业大学计算机与信息学院 合肥2300093
  • 出版日期:2019-06-14 发布日期:2019-07-02
  • 通讯作者: 霍 星(1979-),女,博士,副教授,CCF会员,主要研究领域为机器学习、图形图像处理,E-mail:huoxing@hfut.edu.cn
  • 作者简介:费志伟(1995-),男,硕士生,主要研究领域为深度学习、图像处理;赵 峰(1964-),男,硕士,教授,高级工程师,主要研究领域为智能交通系统;邵 堃(1967-),男,博士,副教授,CCF高级会员,主要研究领域为开放网络环境下的信任评估模型、需求工程、软件理论。
  • 基金资助:
    本文受国家自然科学基金面上项目(61872407,61572167),安徽省科技强警计划项目(1604d0802018),合肥工业大学2017年国家级大学生创新训练计划项目(201710359067),科技部国际合作项目(2015DFA11450),广东省省级科技计划项目(2016B010108002)资助。

Application of Deep Learning in Driver’s Safety Belt Detection

HUO Xing1, FEI Zhi-wei2, ZHAO Feng2, SHAO Kun3   

  1. School of Mathematics,Hefei University of Technology,Hefei 230009,China1;
    School of Software,Hefei University of Technology,Hefei 230009,China2;
    School of Computer Science & Information Engineering,Hefei University of Technology,Hefei 230009,China3
  • Online:2019-06-14 Published:2019-07-02

摘要: 安全带是保障驾驶员安全最有效的措施之一,我国法律明文规定驾驶员驾驶车辆时必须佩带安全带。目前,驾驶过程中安全带佩带的识别以人工筛查为主。随着汽车数量的飞速增加,传统的检测方式已无法满足交通管理的需求,实现安全带检测的自动化处理已成为当前交通系统亟需解决的问题之一。文中设计了一种驾驶人是否佩带安全带的识别系统。首先,通过车牌与车窗位置之间的几何关系进行车窗粗定位;其次,利用霍夫变换检测车窗的上下沿,并利用积分投影变换检测车窗的左右边界,将检测到的图片对半划分,得到驾驶员的粗略位置;最后,基于加入空间变换层的深度卷积神经元网络方法进行安全带的识别分析。针对10000张不同卡口、不同时段实时采集的图片进行实验,结果表明该方法能有效地识别驾驶人是否按规定佩带安全带,且综合识别率相比现有方法有显著提高。

关键词: 安全带检测, 车窗边缘检测, 空间变换神经网络, 深度学习

Abstract: Seat belts are one of the most effective measures to protect safety of drivers which the law stipulates that drivers must wear seat belts when driving the vehicle.At present,the identification of seat belt during driving is mainly based on manual screening.However,the traditional detection methods can not meet the needs of traffic management as the rapid increase of the number of vehicles.And the automatic processing of seat belt detection has become one of the urgent problems in the current traffic system.In this paper,a recognition system for seat belts of drivers is designed.First,the vehicle window is roughly positioned by the geometric relationship between the license plate and the window.Second,Hough transform is used to detect the upper and lower edges of the window and the integral projection transformation is used to detect the left and right borders of the window.The detected pictures will be cut into half to get the driver rough position.Finally,the seat belt identification analysis based on deep convolutional neural network is conducted which adds spatial transform layer.Experiments are carried out on different bayonet and different time periods for 10000 pictures.The experimental results show that the proposed method can effectively identify whether the driver wears the seat belt according to the regulations,and the comprehensive recognition rate is significantly improved compared with the existing method.

Key words: Car window edge detection, Deeping learning, Seat belt detection, Spatial transform networks

中图分类号: 

  • TP27
[1]杨凯杰,章东平,杨力.深度学习的汽车驾驶员安全带检测[J].中国计量大学学报,2017,28(3):326-333.
[2]GUO H W,LIN H,ZHANG S J.Image-based seat belt detection[C]∥Proceedings of IEEE International Conference on Vehicular Electronics and Safety(ICVES).Beijing:IEEE,2011:161-164.
[3]DUDA R O,HART P E.Use of the Hough Transformation to detect lines and curves in pictures[J].Communications of the ACM(CACM),1972,15:11-15.
[4]李万臣,张晋.基于模糊增强的安全带佩戴识别方法[J].应用科技,2015,42(1):22-27.
[5]石时需,秦勇,蔡昭权,等.基于高速公路交通图像的安全带自动识别算法[J].计算机与现代化,2014,5:118-121.
[6]程伟.基于图像分析的未系安全带自动检测方法研究[D].沈阳:沈阳理工大学,2016.
[7]唐恬,王秋,李旭.基于图像的驾驶员安全带自动检测系统[J].中国人民公安大学学报(自然科学版),2016,22(2):71-74.
[8]傅生辉.驾驶人未系安全带识别系统研究[D].济南:山东农业大学,2016.
[9]陈雁翔,李赓.基于Adaboost 的安全带检测系统[J].电子测量技术,2015,38(4):123-127.
[10]吴法.图像处理与机器学习在未系安全带驾车检测中的应用[D].杭州:浙江大学,2013.
[11]姚东明,韩安华.基于车窗检测的车身颜色识别方法研究[J].信息通信,2017(2):87-88,90.
[12]周飞燕,金林鹏,董军.卷积神经网络研究综述[J].计算机学报,2017,40(6):1229-1251.
[13]JADERBERG M,SIMONYAN K,ZISSERMAN A,et al.Special transformer networks[C]∥Proceedings of the 28th International Conference on Neural Information Processing Systems(NIPS).Montréal:NIPS,2015.
[14]欧阳针,陈玮.基于可变形卷积神经网络的图像分类研究[J].软件导刊,2017,16(6):198-201.
[15]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.Imagenet classification with deep convolutional neural networks[C]∥Proceedings of the 25th International Conference on Neural Information Processing Systems(NIPS).Nevada:NIPS,2012:1097-1105.
[16]王运琼,游志胜.基于色差均值的快速车窗定位算法[J].计算机应用与软件,2004,21(1):78-79,117.
[17]侯殿福.车窗检测技术研究[D].北京:北京交通大学,2012.
[1] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[3] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[4] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[5] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[6] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[7] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[8] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[9] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[10] 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木.
中文预训练模型研究进展
Advances in Chinese Pre-training Models
计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[11] 周慧, 施皓晨, 屠要峰, 黄圣君.
基于主动采样的深度鲁棒神经网络学习
Robust Deep Neural Network Learning Based on Active Sampling
计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[12] 苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫.
小样本雷达辐射源识别的深度学习方法综述
Survey of Deep Learning for Radar Emitter Identification Based on Small Sample
计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[13] 刘伟业, 鲁慧民, 李玉鹏, 马宁.
指静脉识别技术研究综述
Survey on Finger Vein Recognition Research
计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056
[14] 孙福权, 崔志清, 邹彭, 张琨.
基于多尺度特征的脑肿瘤分割算法
Brain Tumor Segmentation Algorithm Based on Multi-scale Features
计算机科学, 2022, 49(6A): 12-16. https://doi.org/10.11896/jsjkx.210700217
[15] 康雁, 徐玉龙, 寇勇奇, 谢思宇, 杨学昆, 李浩.
基于Transformer和LSTM的药物相互作用预测
Drug-Drug Interaction Prediction Based on Transformer and LSTM
计算机科学, 2022, 49(6A): 17-21. https://doi.org/10.11896/jsjkx.210400150
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!