计算机科学 ›› 2020, Vol. 47 ›› Issue (4): 142-149.doi: 10.11896/jsjkx.190500021

• 计算机图形学&多媒体 • 上一篇    下一篇

基于改进Enet网络的车道线检测算法

刘彬, 刘宏哲   

  1. 北京联合大学北京市信息服务工程重点实验室 北京100101
  • 收稿日期:2019-05-06 出版日期:2020-04-15 发布日期:2020-04-15
  • 通讯作者: 刘宏哲(liuhongzhe@buu.edu.cn)
  • 基金资助:
    国家自然科学基金(61871039,61802019,61906017);北京市属高校高水平教师队伍建设支持计划项目(IDHT20170511);北京市自然科学基金(4184088);北京联合大学领军人才项目(BPHR2019AZ01);北京市教委项目(KM201911417001,KM201711417005);国家科技支撑计划项目(2015BAH55F03);智能驾驶大数据协同创新中心(CYXC1902)

Lane Detection Algorithm Based on Improved Enet Network

LIU Bin, LIU Hong-zhe   

  1. Key Laboratory of Information Service Engineering,Beijing Union University,Beijing 100101,China
  • Received:2019-05-06 Online:2020-04-15 Published:2020-04-15
  • Contact: LIU Hong-zhe,born in 1971,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.Her main research interests include visual computing and deep learning.
  • About author:LIU Bin,born in 1991,postgraduate.His main research interests include digi-tal image processing and deep learning.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61871039,61802019,61906017),Supporting Plan for Cultivating High Level Teachers in Colleges and Universities in Beijing (IDHT20170511),Beijing Natural Science Foundation(4184088),Premium Funding Project for Academic Human Resources Development in Beijing Union University (BPHR2019AZ01),Beijing Municipal Commission of Education Project (KM201911417001,KM201711417005),National Key Technology R&D Program (2015BAH55F03) and Big Data Collaborative Innovation Center for Intelligent Driving (CYXC1902)

摘要: 针对实际驾驶环境中道路场景及车道线复杂多样的问题,提出一种基于改进Enet网络的车道线检测算法。首先,对Enet网络进行剪枝和卷积优化操作,并利用改进的Enet网络对车道线进行像素级图像语义分割,将车道线从图像中分离出来。然后,采用DBSCAN算法对分割结果进行聚类处理,将相邻车道线区分开来。最后,对车道线聚类结果进行自适应拟合,得到最终的车道线检测结果。该算法在香港中文大学的CULane数据集上进行了训练和测试,结果表明,其标准路面检测准确率达到96.3%,各种路面综合检测准确率为78.9%,图像帧处理速度为71.4fps,能够满足实际驾驶环境中的复杂路况和实时性需求。此外,该算法还在图森未来的TuSimple数据集和实采数据集LD-Data上进行了训练和测试,均取得了实时性的检测结果。

关键词: 车道线检测, 聚类, 图像语义分割, 自适应拟合

Abstract: Aiming at the complex diversity of road scenes and lane lines in the actual driving environment,a lane-line detection algorithm based on improved Enet network was proposed.Firstly,the Enet network is pruned and convolution optimized.The improved Enet network is used to segment the lane-line image semantics and separate the lane lines from the image.Then,the DBSCAN algorithm is used to cluster the segmentation results to distinguish adjacent lane lines from each other.Finally,the lane line clustering results are adaptively fitted to obtain the final lane line detection results.The proposed algorithm was trained and testedin the CULane dataset of the Chinese University of Hong Kong.The accuracy of standard pavement detection is 96.3%,the accuracy of comprehensive pavement detection is 78.9%,and the image frame processing speed is 71.4fps,which can meet the complex road conditions and real-time requirementsin actual driving environment.In addition,the proposed algorithm has been trained and tested on Tucson’s future TuSimple dataset and our actual acquisition dataset LD-Data,all of which have achievedrealtime detection results.

Key words: Adaptive fitting, Clustering, Image semantics segmentation, Lane detection

中图分类号: 

  • TP391.4
[1]CHANG C Y,LIN C H.An Efficient Method for Lane-mark Extraction in Complex Conditions[C]// 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing.IEEE,2012:330-336.
[2]LEE C,DING D.An Adaptive Road ROI Determination Algorithm for Lane Detection[J].Journal of the Institute of Electronics and Information Engineers,2014,51(1):116-125.
[3]BENLIGIRAY B,TOPAL C,AKINLAR C.Video-Based Lane Detection Using a Fast Vanishing Point Estimation Method[C]//IEEE International Symposium on Multimedia.IEEE,2012:348-351.
[4]WANG J Y,DUAN J M.Lane Detection Algorithm Using Vanishing Point[C]//2013 International Conference on Machine Learning and Cybernetics.IEEE,2013,2:735-740.
[5]LI W,GONG X,WANG Y,et al.A Lane Marking Detection and Tracking Algorithm Based on Sub-Regions[C]// Proceedings 2014 International Conference on Informative and Cybernetics for Computational Social Systems (ICCSS).IEEE,2014:68-73.
[6]TAN H,ZHOU Y,ZHU Y,et al.A novel curve lane detection based on Improved River Flow and RANSA[C]//17th International IEEE Conference on Intelligent Transportation Systems (ITSC).IEEE,2014:133-138.
[7]LI H,FENG M,WANG X.Inverse Perspective Mapping Based Urban Road Markings Detection [C]//2012 IEEE 2nd International Conference on Cloud Computing and Intelligence Systems.IEEE,2012:1178-1182.
[8]MU C,MA X.Lane Detection Based on Object Segmentationand Piecewise Fitting[J].Telkomnika Indonesian Journal of Electrical Engineering,2014,12(5):3491-3500.
[9]KIM J,LEE M.Robust Lane Detection Based on Convolutional Neural Network and Random Sample Consensus[C]//International Conference on Neural Information Processing.Cham:Springer,2014:454-461.
[10]HUVAL B,WANG T,TANDON S,et al.An Empirical Evaluation of Deep Learning on Highway Driving[J].arXiv:1504.01716.
[11]LI J,MEI X,PROKHOROV D,et al.Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene[J].IEEE Transactions on Neural Networks and Learning Systems,2017,28(3):690-703.
[12]HE B,AI R,YAN Y,et al.Accurate and Robust Lane DetectionBased on Dual-View Convolutional Neutral Network [C]//2016 IEEE Intelligent Vehicles Symposium (IV).IEEE,2016:1041-1046.
[13]BAILO O,LEE S,RAMEAU F,et al.Robust Road Marking Detection and Recognition Using Density-based Grouping and Machine Learning Techniques[C]//2017 IEEE Winter Confe-rence on Applications of Computer Vision (WACV).IEEE,2017:760-768.
[14]CHAN T H,JIA K,GAO S,et al.PCANet:A Simple Deep Learning Baseline for Image Classification?[J].IEEE Transactions on Image Processing,2015,24(12):5017-5032.
[15]LEE S,KIM J,YOON J S,et al.VPGNet:Vanishing PointGuided Network for Lane and Road Marking Detection and Recognition[J].arXiv:1710.06288,2017.
[16]PASZKE A,CHAURASIA A,KIM S,et al.ENet:A Deep Neural Network Architecture for Real-Time Semantic Segmentation[J].arXiv:1606.02147,2016.
[17]IOFFE S,SZEGEDY C.Batch Normalization:Accelerating Deep Network Training by Reducing Internal Covariate Shift[C]// International Conference on International Conference on Machine Learning.JMLR.org,2015:1-11.
[18]HE K,ZHANG X,REN S,et al.Delving Deep into Rectifiers:Surpassing Human-level Performance on Imagenet Classification[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:1026-1034.
[19]TOMPSON J,GOROSHIN R,JAIN A,et al.Efficient ObjectLocalization Using Convolutional Networks[C]//IEEE Confe-rence on Computer Vision and Pattern Recognition.2015:648-656.
[20]PAN X,SHI J,LUO P,et al.Spatial As Deep:Spatial CNN for Traffic Scene Understanding[C]// IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2017:1-8.
[1] 柴慧敏, 张勇, 方敏.
基于特征相似度聚类的空中目标分群方法
Aerial Target Grouping Method Based on Feature Similarity Clustering
计算机科学, 2022, 49(9): 70-75. https://doi.org/10.11896/jsjkx.210800203
[2] 鲁晨阳, 邓苏, 马武彬, 吴亚辉, 周浩浩.
基于分层抽样优化的面向异构客户端的联邦学习
Federated Learning Based on Stratified Sampling Optimization for Heterogeneous Clients
计算机科学, 2022, 49(9): 183-193. https://doi.org/10.11896/jsjkx.220500263
[3] 刘丽, 李仁发.
医疗CPS协作网络控制策略优化
Control Strategy Optimization of Medical CPS Cooperative Network
计算机科学, 2022, 49(6A): 39-43. https://doi.org/10.11896/jsjkx.210300230
[4] 鲁晨阳, 邓苏, 马武彬, 吴亚辉, 周浩浩.
基于DBSCAN聚类的集群联邦学习方法
Clustered Federated Learning Methods Based on DBSCAN Clustering
计算机科学, 2022, 49(6A): 232-237. https://doi.org/10.11896/jsjkx.211100059
[5] 郁舒昊, 周辉, 叶春杨, 王太正.
SDFA:基于多特征融合的船舶轨迹聚类方法研究
SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion
计算机科学, 2022, 49(6A): 256-260. https://doi.org/10.11896/jsjkx.211100253
[6] 毛森林, 夏镇, 耿新宇, 陈剑辉, 蒋宏霞.
基于密度敏感距离和模糊划分的改进FCM算法
FCM Algorithm Based on Density Sensitive Distance and Fuzzy Partition
计算机科学, 2022, 49(6A): 285-290. https://doi.org/10.11896/jsjkx.210700042
[7] 陈景年.
一种适于多分类问题的支持向量机加速方法
Acceleration of SVM for Multi-class Classification
计算机科学, 2022, 49(6A): 297-300. https://doi.org/10.11896/jsjkx.210400149
[8] 陈佳舟, 赵熠波, 徐阳辉, 马骥, 金灵枫, 秦绪佳.
三维城市场景中的小物体检测
Small Object Detection in 3D Urban Scenes
计算机科学, 2022, 49(6): 238-244. https://doi.org/10.11896/jsjkx.210400174
[9] 邢云冰, 龙广玉, 胡春雨, 忽丽莎.
基于SVM的类别增量人体活动识别方法
Human Activity Recognition Method Based on Class Increment SVM
计算机科学, 2022, 49(5): 78-83. https://doi.org/10.11896/jsjkx.210400024
[10] 朱哲清, 耿海军, 钱宇华.
面向化学结构的线段聚类算法
Line-Segment Clustering Algorithm for Chemical Structure
计算机科学, 2022, 49(5): 113-119. https://doi.org/10.11896/jsjkx.210700131
[11] 张宇姣, 黄锐, 张福泉, 隋栋, 张虎.
基于菌群优化的近邻传播聚类算法研究
Study on Affinity Propagation Clustering Algorithm Based on Bacterial Flora Optimization
计算机科学, 2022, 49(5): 165-169. https://doi.org/10.11896/jsjkx.210800218
[12] 左园林, 龚月姣, 陈伟能.
成本受限条件下的社交网络影响最大化方法
Budget-aware Influence Maximization in Social Networks
计算机科学, 2022, 49(4): 100-109. https://doi.org/10.11896/jsjkx.210300228
[13] 杨旭华, 王磊, 叶蕾, 张端, 周艳波, 龙海霞.
基于节点相似性和网络嵌入的复杂网络社区发现算法
Complex Network Community Detection Algorithm Based on Node Similarity and Network Embedding
计算机科学, 2022, 49(3): 121-128. https://doi.org/10.11896/jsjkx.210200009
[14] 韩洁, 陈俊芬, 李艳, 湛泽聪.
基于自注意力的自监督深度聚类算法
Self-supervised Deep Clustering Algorithm Based on Self-attention
计算机科学, 2022, 49(3): 134-143. https://doi.org/10.11896/jsjkx.210100001
[15] 蒲实, 赵卫东.
一种面向动态科研网络的社区检测算法
Community Detection Algorithm for Dynamic Academic Network
计算机科学, 2022, 49(1): 89-94. https://doi.org/10.11896/jsjkx.210100023
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!