Computer Science ›› 2019, Vol. 46 ›› Issue (7): 233-237.doi: 10.11896/j.issn.1002-137X.2019.07.035

• Graphics, Image & Pattern Recognition • Previous Articles     Next Articles

Lightweight SSD Network for Real-time Object Detection in Automotive Videos

ZHANG Lin-na1,CHEN Jian-qiang1,CHEN Xiao-ling1,CEN Yi-gang2,KAN Shi-chao2   

  1. (School of Mechanical Engineering,Guizhou University,Guiyan 550025,China)1
    (School of Computer Science & Information Technology,Beijing Jiaotong University,Beijing 100044,China)2
  • Received:2018-06-18 Online:2019-07-15 Published:2019-07-15

Abstract: Vehicle and pedestrian detection are the most basic and widely studied subjectin the field of advanced driver-assistance systems (ADAS).At present,deep learning achieved the best detection performance for object detection.However,the computational cost of deep learning algorithms is very high and the algorithms often require high perfor-mance GPU.In the real applications,object detection algorithm is required to be integrated into the vehicle hardware system.So the requirement of the hardware for the algorithm can not be too high.Based on the SSD network,a lightweight SSD network was proposed for real-time objection.By resizing the input images into a smaller size and significantly reducing the node number of the fully connected layer,the network complexity could be reduced.In addition,the object detection speed was improved.A supervised training method based on the multi-stage loss function was proposed to solve the problems of image deformation and the updated parameters in the VGG low layers caused by the shrink of the input images.Furthermore,because the detection accuracy of vehicles and pedestrians would be declined after the reduction of calculations,a hierarchical image partition method was proposed to expand the training dataset,which was able to solve the object vanishing problem caused by the image shrink.Experimental results show that the proposed lightweight SSD network not only realizes real-time vehicle and pedestrian detection on a laptop,but also maintains the detection accuracy.Compared with other object detection algorithms,the optimized network achieves faster detection speed for the vehicles and pedestrians.Also,the power consuming of the laptop is reduced significantly while the detection accuracy is the same.

Key words: Object detection, Deep learning, SSD, Advanced driver-assistance systems, Convolutional neural network

CLC Number: 

  • TP391.44
[1] GIRSHICKR B,DONAHUE J,DARRELL T,et al.Region- based convolutional networks for accurate object detection and segmentation [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2016,38(1):142-158.
[2] GIRSHICKR B.Fast R-CNN[C]∥2015 IEEE International Conference on Computer Vision,ICCV 2015.Santiago,Chile,2015:1440-1448.
[3] REN S,HE K,GIRSHICKR B,et al.Faster R-CNN:towards real-time object detection with region proposal networks [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):1137-1149.
[4] LIU W,ANGUELOV D,ERHAN D,et al.SSD:single shot multibox detector[C]∥Computer Vision-ECCV 2016-14th European Conference,Amsterdam,The Netherlands,2016:21-37.
[5] REDMON J,DIVVALAS K,GIRSHICKR B,et al.You only look once:unified,real-time object detection[C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition,CVPR 2016.Las Vegas,NV,USA,2016:779-788.
[6] SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[C]∥International Conference on Learning Representations.San Diego,USA,2015:2015-2029.
[7] CHEN S,PEI H,LAI Q,et al.Multitarget Tracking Control for Coupled Heterogeneous Inertial Agents Systems Based on Flocking Behavior[J].IEEE Transactions on Systems Man & Cybernetics Systems,2018,PP(99):1-7.
[8] DAI J,LI Y,HE K,et al.R-FCN:object detection via region-based fully convolutional networks[C]∥Advances in Neural Information Processing Systems 29:Annual Conference on Neural Information Processing Systems 2016.Barcelona,Spain,2016:379-387.
[9] REDMON J,FARHADI A.YOLO9000:better,faster,stronger[C]∥IEEE Conference on Computer Vision and Pattern Recognition,CVPR 2017.Honolulu,HI,USA,2017:6517-6525.
[10] KIM K H,HONG S,ROH B,et al.PVANET:deep but lightweight neural networks for real-time object detection[J].arXiv:1608.08021.
[11] DAI J,QI H,XIONG Y,et al.Deformable convolutional net- works[J].CoRR,abs/1703.06211,1(2),3.
[12] HUANG J,RATHOD V,SUN C,et al.Speed/accuracy trade-offs for modern convolutional object detectors[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Honolulu,Hawaii,USA,2017:3296-3297.
[13] KANG K,LI H,XIAO T,et al.Object detection in videos with tubelet proposal networks[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Honolulu,Hawaii,USA,2017:889-897.
[14] KAN S C,CEN Y G,CEN Y,et al.SURF binarization and fast codebook construction for image retrieval [J].Journal of Visual Communication & Image Representation,2017,49:104-114.
[15] GEIGER A.Are we ready for autonomous driving? The KITTI vision benchmark suite[C]∥IEEE Conference on Computer Vision and Pattern Recognition,Providence,RI,USA,2012:3354-3361.
[16] YUAN Y,YANG K,ZHANG C.Hard-aware deeply cascaded embedding[C]∥IEEE International Conference on Computer Vision,Venice,Italy,2017:814-823.
[17] EVERINGHAM M,GOOL L,WILLIAMS C K,et al.The Pascal Visual Object Classes (VOC) Challenge[J].International Journal of Computer Vision,2010,88(2):303-338.
[18] LI H,HUANG Y,ZHANG Z.An improved Faster R-CNN for same object retrieval[J].IEEE Access,2017,5:13665-13676.
[1] SHAN Mei-jing, QIN Long-fei, ZHANG Hui-bing. L-YOLO:Real Time Traffic Sign Detection Model for Vehicle Edge Computing [J]. Computer Science, 2021, 48(1): 89-95.
[2] HE Yan-hui, WU Gui-xing, WU Zhi-qiang. Domain Alignment Based Object Detection of X-ray Images [J]. Computer Science, 2021, 48(1): 175-181.
[3] LI Ya-nan, HU Yu-jia, GAN Wei, ZHU Min. Survey on Target Site Prediction of Human miRNA Based on Deep Learning [J]. Computer Science, 2021, 48(1): 209-216.
[4] WANG Rui-ping, JIA Zhen, LIU Chang, CHEN Ze-wei, LI Tian-rui. Deep Interest Factorization Machine Network Based on DeepFM [J]. Computer Science, 2021, 48(1): 226-232.
[5] YU Wen-jia, DING Shi-fei. Conditional Generative Adversarial Network Based on Self-attention Mechanism [J]. Computer Science, 2021, 48(1): 241-246.
[6] TONG Xin, WANG Bin-jun, WANG Run-zheng, PAN Xiao-qin. Survey on Adversarial Sample of Deep Learning Towards Natural Language Processing [J]. Computer Science, 2021, 48(1): 258-267.
[7] DING Yu, WEI Hao, PAN Zhi-song, LIU Xin. Survey of Network Representation Learning [J]. Computer Science, 2020, 47(9): 52-59.
[8] HE Xin, XU Juan, JIN Ying-ying. Action-related Network:Towards Modeling Complete Changeable Action [J]. Computer Science, 2020, 47(9): 123-128.
[9] ZHANG Jia-jia, ZHANG Xiao-hong. Multi-branch Convolutional Neural Network for Lung Nodule Classification and Its Interpretability [J]. Computer Science, 2020, 47(9): 129-134.
[10] YE Ya-nan, CHI Jing, YU Zhi-ping, ZHAN Yu-liand ZHANG Cai-ming. Expression Animation Synthesis Based on Improved CycleGan Model and Region Segmentation [J]. Computer Science, 2020, 47(9): 142-149.
[11] ZHU Ling-ying, SANG Qing-bing, GU Ting-ting. No-reference Stereo Image Quality Assessment Based on Disparity Information [J]. Computer Science, 2020, 47(9): 150-156.
[12] DENG Liang, XU Geng-lin, LI Meng-jie, CHEN Zhang-jin. Fast Face Recognition Based on Deep Learning and Multiple Hash Similarity Weighting [J]. Computer Science, 2020, 47(9): 163-168.
[13] CUI Tong-tong, WANG Gui-ling, GAO Jing. Ship Trajectory Classification Method Based on 1DCNN-LSTM [J]. Computer Science, 2020, 47(9): 175-184.
[14] QI Shao-hua, XU He-gen, WAN You-wen, FU Hao. Construction of Semantic Mapping in Dynamic Environments [J]. Computer Science, 2020, 47(9): 198-203.
[15] LIU Hai-chao, WANG Li. Graph Classification Model Based on Capsule Deep Graph Convolutional Neural Network [J]. Computer Science, 2020, 47(9): 219-225.
Full text



[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75 .
[2] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[3] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[4] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[5] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99 .
[6] ZHOU Yan-ping and YE Qiao-lin. L1-norm Distance Based Least Squares Twin Support Vector Machine[J]. Computer Science, 2018, 45(4): 100 -105 .
[7] LIU Bo-yi, TANG Xiang-yan and CHENG Jie-ren. Recognition Method for Corn Borer Based on Templates Matching in Muliple Growth Periods[J]. Computer Science, 2018, 45(4): 106 -111 .
[8] GENG Hai-jun, SHI Xin-gang, WANG Zhi-liang, YIN Xia and YIN Shao-ping. Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph[J]. Computer Science, 2018, 45(4): 112 -116 .
[9] CUI Qiong, LI Jian-hua, WANG Hong and NAN Ming-li. Resilience Analysis Model of Networked Command Information System Based on Node Repairability[J]. Computer Science, 2018, 45(4): 117 -121 .
[10] WANG Zhen-chao, HOU Huan-huan and LIAN Rui. Path Optimization Scheme for Restraining Degree of Disorder in CMT[J]. Computer Science, 2018, 45(4): 122 -125 .