计算机科学 ›› 2020, Vol. 47 ›› Issue (12): 252-257.doi: 10.11896/jsjkx.191000069

• 人工智能 • 上一篇    下一篇

基于特征检测与深度特征描述的点云粗对齐算法

史文凯, 张昭晨, 喻孟娟, 吴瑞, 聂建辉   

  1. 南京邮电大学自动化、人工智能学院 南京 210023
  • 收稿日期:2019-10-13 修回日期:2020-01-17 发布日期:2020-12-17
  • 通讯作者: 聂建辉 (njh19@163.com)
  • 作者简介:wenkaishi.njupt@gmail.com
  • 基金资助:
    江苏省青年科学基金(BK20140892);国家自然科学基金青年科学基金(61802204)

Point Cloud Coarse Alignment Algorithm Based on Feature Detection and Depth FeatureDescription

SHI Wen-kai, ZHANG Zhao-chen, YU Meng-juan, WU Rui, NIE Jian-hui   

  1. College of Automation & Artificial Intelligence Nanjing University of Posts and Telecommunications Nanjing 210023,China
  • Received:2019-10-13 Revised:2020-01-17 Published:2020-12-17
  • About author:SHI Wen-kai,born in 1995postgra-duate.His main research interests include discrete geometric processing and so on.
    NIE Jian-hui,born in 1984Ph.Dassociate professorpostgraduate supervisoris a member of China Computer Federation.His main research interests include geometric processing and optical measurement.
  • Supported by:
    Jiangsu Youth Science Foundation(BK20140892) and National Natural Science Foundation of China(61802204).

摘要: 点云对齐是点云数据处理的重要步骤之一粗对齐则是其中的难点.近年来基于深度学习的点云对齐取得了较大进展特别是3DMatch方法能够在噪声、低分辨率以及数据缺失的条件下取得较好的对齐效果.3DMatch采用随机采样的方式产生待匹配点当采样点个数较少时会导致匹配率较低因此对齐效果不佳.为此利用ISS特征点检测代替随机采样然后以3DMatch为特征点生成描述符最后通过匹配特征描述符实现数据对齐.由于ISS特征点检测具有良好的重复性同时3DMatch能够提供具有高区分度的描述符因此该方法大大提高了匹配的鲁棒性和准确性.实验结果表明与随机采样相比特征点采样在初始点云无噪、弱噪和强噪的情况下对齐效果更好、鲁棒性更强并且在粗对齐效果相似的情况下所需特征采样点的个数仅为随机采样点个数的10%极大地提高了对齐的效率.

关键词: 3DMatch, 粗对齐, 点云对齐, 深度学习, 特征点检测

Abstract: Point cloud alignment is one of the important steps in point cloud data processingand coarse alignment is the hard part.In recent yearsgreat progress has been made in point cloud alignment based on deep learning.In particularthe method of 3DMatch can achieve a better alignment effect under the conditions of noiselow resolution and missing data.Howeverthis method uses random sampling to generate alignment points.When the number of sampling points is smallthe matching rate will be low and the alignment effect is not good.ThereforeISS feature point detection is used instead of random samplingand then 3DMatch is used to generate descriptors for feature points.Finallydata alignment is achieved through matching feature descriptors.Since ISS feature point detection has good repeatability and 3DMatch can provide descriptors with high degree of discriminationthis method greatly improves the robustness and accuracy of matching.Eexperiment shows thatcompared with random samplingthe alignment effect and robustness of feature point sampling are better when the initial point cloud has no noiseweak noise and strong noise.Moreoverwhen the coarse alignment effect is similarthe number of feature points only accounts for 10% of the number of random pointswhich greatly improves the alignment efficiency.

Key words: 3DMatch, Coarse alignment, Deep learning, Feature point detection, Point cloud alignment

中图分类号: 

  • TP391
[1] BESL P J.A method for registration 3D shapes[J].IEEE Tran-sactions on Pattern Analysis and Machine Intelligence,1992,14(2):193-200.
[2] ZHOU F Q,ZHOU M Q.Improved probability iterative closest point registration agorithm[J].Journal of Graphics,2017,38(1):15-22.
[3] ZENG A,SONG S,NIEβNER M,et al.3DMatch:Learning Local Geometric Descriptors from RGB-D Reconstructions[C]//IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2017:199-208.
[4] LI J,YANG X R,HE B.Geometric Features Matching with Deep Learning[J].Computer Science,2019,46(7):274-279.
[5] VALENTIN J,DAI A,NIEβNER M,et al.Learning to Navigate the Energy Landspace[C]//IEEE 2016 Fourth International Conference on 3D Vision(3DV).Stanford,USA,2016:323-332.
[6] ZHONG Y.Intrinsic Shape Signatures:A Shape Descriptor for 3d Object Recognition[C]//Proceedings of 2009 IEEE 12th International Conference on Computer Vision Workshops.2009:689-696.
[7] AIGER D,MITRA N J,COHEN-OR D.4-points congruent sets for robust pairwise surface registration[J].Acm Transactions on Graphics,2008,27(3):1-10.
[8] YU W L,ZHOU M Q,SHUI W Y,et al.AutomaticRegistration Method Based on Curvature[J].Journal of System Simulation,2015,27(10):2374- 2379,2386.
[9] LEBEDA K,MATAS J,CHUM O.Fixing Locally OptimizedRANSAC Full Experimental Evaluation[C]//British Machine Vision Conference on Neural Information Processing Systems.2012:1-11.
[10] MELLADO N,AIGER D,MITRA N J.Super 4pcs fast global pointcloud registration via smart indexing[J].ComputerGra-phics Forum,2014,3(5):205-215.
[11] LU J,PENG Z T,DONGD L.The Registration Algorithm of Point Cloud Based on Optimal Extraction of FPFH Feature[J].New Industrialization Straregy,2014,4(7):75-81.
[12] RUSU R B,NICO B,MICHAL B.Fast Point Feature Histo-grams (FPFH) for 3D Registration[C]//2009 IEEE International Conference on Robotics and Automation.Kobe,IEEE,2009:3212-3217.
[13] WU Z,SONG S,KHOSLA A,et al.3D ShapeNets:A Deep Re-presentation for Volumetric Shapes[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2015:1912-1920.
[14] GUO K,ZOU D,CHEN X.3D Mesh Labeling via Deep Convolutional Neural Networks[J].Acm Transactions on Graphics,2015,35(1):1-12.
[15] QUAN S W,MA J.On Shortened Local Binary Descriptors[J].Information Science,2020,510:33-49.
[16] SRIVASTAVA S,LALL B.DeepPoint3D:Learning Discriminative Local Descriptors using Deep Metric Learning on 3D Point Clouds[J].Pattern Recognition Letters,2019,127:27-36.
[17] LOWE D G.Distinctive image features from scale-invari-ant key points[J].International Journal of Computer Vision,2004,60(2):91-110.
[18] STEDER B,RUSU R B,KONOLIGE K,et al.Point Feature Extraction On 3D Range Scans Taking Into Account Object Boundaries[C]//Proceedings of 2011 IEEE International Conference on Robotics and Automation.2011:2601-2608.
[19] HARRIS C G,STEPHENS M.A combined corner and edge detector[C]//Proceedings of Fourth the Alvey Vision Conference.1998:147-158.
[20] ANGELO L D,GIACCARI L.An efficient algorithm for the nearest neighbourhood search for point clouds[J].International Journal of Computer Science Issues,2011,8(5):1-11.
[1] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[3] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[4] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[5] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[6] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[7] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[8] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[9] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[10] 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木.
中文预训练模型研究进展
Advances in Chinese Pre-training Models
计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[11] 周慧, 施皓晨, 屠要峰, 黄圣君.
基于主动采样的深度鲁棒神经网络学习
Robust Deep Neural Network Learning Based on Active Sampling
计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[12] 苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫.
小样本雷达辐射源识别的深度学习方法综述
Survey of Deep Learning for Radar Emitter Identification Based on Small Sample
计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[13] 祝文韬, 兰先超, 罗唤霖, 岳彬, 汪洋.
改进Faster R-CNN的光学遥感飞机目标检测
Remote Sensing Aircraft Target Detection Based on Improved Faster R-CNN
计算机科学, 2022, 49(6A): 378-383. https://doi.org/10.11896/jsjkx.210300121
[14] 王建明, 陈响育, 杨自忠, 史晨阳, 张宇航, 钱正坤.
不同数据增强方法对模型识别精度的影响
Influence of Different Data Augmentation Methods on Model Recognition Accuracy
计算机科学, 2022, 49(6A): 418-423. https://doi.org/10.11896/jsjkx.210700210
[15] 毛典辉, 黄晖煜, 赵爽.
符合监管合规性的自动合成新闻检测方法研究
Study on Automatic Synthetic News Detection Method Complying with Regulatory Compliance
计算机科学, 2022, 49(6A): 523-530. https://doi.org/10.11896/jsjkx.210300083
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!