Computer Science ›› 2020, Vol. 47 ›› Issue (9): 198-203.doi: 10.11896/jsjkx.191000040

• Artificial Intelligence • Previous Articles     Next Articles

Construction of Semantic Mapping in Dynamic Environments

QI Shao-hua, XU He-gen, WAN You-wen, FU Hao   

  1. College of Electronics and Information Engineering,Tongji University,Shanghai 201804,China
  • Received:2019-10-09 Published:2020-09-10
  • About author:QI Shao-hua,born in 1995,postgra-duate.His main research interests include visual SLAM,deep learning and augmented reality.
    XU He-gen,born in 1972,Ph.D,asso-ciate professor.His main research inte-rests include image processing,machine vision,pattern recognition and robot.

Abstract: Three-dimensional semantic maps play a key role in tasks such as robot navigation,path planning,intelligent grasping and human-computer interaction.So how to construct 3D semantic maps in real time is especially important.The current SLAM (simultaneous localization and mapping) algorithm can achieve higher positioning and mapping accuracy.However,how to eliminate dynamic objects to obtain higher positioning accuracy in a dynamic environment,and to understand the existence of objects and their location information in the surrounding scenes are still not well solved.This paper presents an algorithm for constructing semantic maps in a dynamic environment.This algorithm is improved on ORB-SLAM2.The dynamic and static point detection algorithm is added to the tracking thread to eliminate the feature points detected as dynamic feature points,which improves the positioning accuracy in dynamic environment.Object detection threads are added to detect key images.The mapping threads are added with the Octo-Map dense map construction.At the same time,the 3D object database is constructed according to the detection results.In order to prove the feasibility of the algorithm,the laboratory is used as the test environment,and the object detection,dynamic point detection,3D target information acquisition,and semantic map construction experiments in the dynamic environment are performed.In the object detection experiment,a high-speed and high-precision object detection network,mobilenet-v2-ssdlite,is trained,which can reach a detection speed of 7 frames/s,which can basically achieve real-time detection.In dynamic point detection,the optical flow method was used to eliminate dynamic point,processing speed is 16.5 frames/s.And this paper creates a data set to evaluate the performance of the algorithm.Compared with the original ORB-SLAM2 algorithm,the positioning accuracy is improved by 5 times after combining with the optical flow method.For the acquisition of three-dimensional object information,two methods based on depth filtering and point cloud segmentation are adopted.The results show that the latter’s 3D object acquisition is more accurate.Finally,the entire laboratory is constructed with a semantic map in a dynamic environment,an Octo-Map dense map is constructed,and a 3D object database is constructed based on the detection results.The detected values of the object size and position are compared with the true values,and the errors are within 5cm.The results show that the proposed algorithm has high accuracy and real-time performance.

Key words: Dynamic point detection, Object detection, Semantic mapping, Visual SLAM

CLC Number: 

  • TP249
[1] LIU W,ANGUELOV D,ERHAN D,et al.SSD:single shotmultibox detector[C]//European Conference on Computer Vision.Berlin,German:Springer,2016:21-37.
[2] REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:Unified,real-time object detection[J].arXiv:1506.02640 v4,2015.
[3] REN S,HE K,GIRSHICK R,et al.Faster R-CNN:Towards Real-Time Object Detection with Region Proposal Networks[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2015,39(6):1137-1149.
[4] HOWARD A,ZHU M,CHEN B,et al.Mobilenets:Efficientconvolutional neural networks for mobile vision applications[J].arXiv:1704.04861,2017.
[5] SANDLER M,HOWARD A,ZHU M L,et al.MobileNetV2:invertedresiduals and linear bottlenecks [J].arXiv:1801.04381[cs.CV],2018.
[6] MUR-ARTAL R,MONTIEL J M M,TARDOS J D.ORB-SLAM:a versatile and accurate monocular SLAM system [J].IEEE Transactions on Robotics,2015,31(5):1147-1163.
[7] MUR-ARTAL R,TARDOS J D.ORB-SLAM2:an Open-Source SLAM system for monocular stereo and RGB-D cameras [J].IEEE Transactions on Robotics,2017,33(5):1255-1262.
[8] BERTA B,FACIL J M,JAVIER C,et al.DynaSLAM:Track-ing,Mapping and Inpainting in Dynamic Scenes[J].arXiv:1806.05620v1,2018.
[9] YU C,LIU Z,LIU X,et al.DS-SLAM:A Semantic VisualSLAM towards Dynamic Environments[J].arXiv:1809.08379v2,2018.
[10] SALAS-MORENO R F,NEWCOMBE R A,STRASDAT H,et al.SLAM++:Simultaneous localisation and mapping at the level of objects[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway,USA:IEEE,2013:1352-1359.
[11] HERMANS A,FLOROS G,LEIBE B.Dense 3D semantic mapping of indoor scenes from RGB-D images[C]//IEEE International Conference on Robotics and Automation.Piscataway,USA:IEEE,2014:2631-2638.
[12] CONCHA A,CIVERA J.DPPTAM:Dense piecewise planartracking and mapping from a monocular sequence[C]//IEEE/RSJ International Conference on Intelligent Robots and Systems.Piscat- away,USA:IEEE,2015:5686-5693.
[13] TATENO K,TOMBARI F,LAINA I,et al.CNN-SLAM:Realtime dense monocular SLAM with learned depth prediction[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway,USA:IEEE,2017:6565-6574.
[14] MCCORMAC J,HANDA A,DAVISON A,et al.Semantic Fu-sion Dense 3D semantic mapping with convolutional neural networks[C]//IEEE International Conference on Robotics and Automation.Piscataway,USA:IEEE,2017:4628-4635.
[15] JIANG W T.Construction of dense semantic map of large-scale road[D].Hangzhou:Zhejiang University,2016.
[16] YU J S,WU H,TIAN G H,et al.Semantic database design and semantic map construction of robots based on the cloud[J].Robot,2016,38(4):410-419.
[17] XING Q W.Construction of robot semantic map under unknown environment[D].Changchun:Northeast Normal University,2017.
[18] HAO W,GUOHUI T,PENG D,et al.Characterization of large-scale unknown environmental information based on RFID technology[J].Journal of Central South University(Natural Science Edition),2013(S1):166-170.
[19] ZHAO Z,CHEN X.Building 3D semantic maps for mobile robots using RGB-D camera[J].Intelligent Service Robotics,2016,9(4):1-13.
[20] HORNUNG A,WURM K M,BENNEWITZ M,et al.OctoMap:an efficient probabilistic 3D mapping framework based on octrees[J].Autonomous Robots,2013,34(3):189-206.
[21] JÜRGEN S,ENGELHARD N,ENDRES F,et al.A benchmark for the evaluation of RGB-D SLAM systems[C]//2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.IEEE,2012.
[1] LIU Dong-mei, XU Yang, WU Ze-bin, LIU Qian, SONG Bin, WEI Zhi-hui. Incremental Object Detection Method Based on Border Distance Measurement [J]. Computer Science, 2022, 49(8): 136-142.
[2] WANG Can, LIU Yong-jian, XIE Qing, MA Yan-chun. Anchor Free Object Detection Algorithm Based on Soft Label and Sample Weight Optimization [J]. Computer Science, 2022, 49(8): 157-164.
[3] CHEN Yong-ping, ZHU Jian-qing, XIE Yi, WU Han-xiao, ZENG Huan-qiang. Real-time Helmet Detection Algorithm Based on Circumcircle Radius Difference Loss [J]. Computer Science, 2022, 49(6A): 424-428.
[4] CHEN Jia-zhou, ZHAO Yi-bo, XU Yang-hui, MA Ji, JIN Ling-feng, QIN Xu-jia. Small Object Detection in 3D Urban Scenes [J]. Computer Science, 2022, 49(6): 238-244.
[5] HU Fu-yuan, WAN Xin-jun, SHEN Ming-fei, XU Jiang-lang, YAO Rui, TAO Zhong-ben. Survey Progress on Image Instance Segmentation Methods of Deep Convolutional Neural Network [J]. Computer Science, 2022, 49(5): 10-24.
[6] XU Tao, CHEN Yi-ren, LYU Zong-lei. Study on Reflective Vest Detection for Apron Workers Based on Improved YOLOv3 Algorithm [J]. Computer Science, 2022, 49(4): 239-246.
[7] YUAN Lei, LIU Zi-yan, ZHU Ming-cheng, MA Shan-shan, CHEN Lin-zhou-ting. Improved YOLOv3 Remote Sensing Target Detection Based on Improved Dense Connection and Distributional Ranking Loss [J]. Computer Science, 2021, 48(9): 168-173.
[8] GONG Hao-tian, ZHANG Meng. Lightweight Anchor-free Object Detection Algorithm Based on Keypoint Detection [J]. Computer Science, 2021, 48(8): 106-110.
[9] LI Lin, LIU Xue-liang, ZHAO Ye, JI Ping. Low Light Image Fusion Detection Method Based on Lego Filter and SSD [J]. Computer Science, 2021, 48(7): 213-218.
[10] XIN Yuan-xue, SHI Peng-fei, XUE Rui-yang. Moving Object Detection Based on Region Extraction and Improved LBP Features [J]. Computer Science, 2021, 48(7): 233-237.
[11] ZHANG Man, LI Jie, ZHU Xin-zhong, SHEN Ji, CHENG Hao-tian. Augmentation Technology of Remote Sensing Dataset Based on Improved DCGAN Algorithm [J]. Computer Science, 2021, 48(6A): 80-84.
[12] PAN Ming-yuan, SONG Hui-hui, ZHANG Kai-hua, LIU Qing-shan. Learning Global Guided Progressive Feature Aggregation Lightweight Network for Salient Object Detection [J]. Computer Science, 2021, 48(6): 103-109.
[13] ZHANG Shao-qin, DU Sheng-dong, ZHANG Xiao-bo, LI Tian-rui. Social Rumor Detection Method Based on Multimodal Fusion [J]. Computer Science, 2021, 48(5): 117-123.
[14] SHI Xian-rang, SONG Ting-lun, TANG De-zhi, DAI Zhen-yong. Novel Deep Learning Algorithm for Monocular Vision:H_SFPN [J]. Computer Science, 2021, 48(4): 130-137.
[15] YUAN Xing-xing, WU Qin. Object Detection in Remote Sensing Images Based on Saliency Feature and Angle Information [J]. Computer Science, 2021, 48(4): 174-179.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!