计算机科学 ›› 2019, Vol. 46 ›› Issue (7): 274-279.doi: 10.11896/j.issn.1002-137X.2019.07.042

• 图形图像与模式识别 • 上一篇    下一篇

基于深度学习的几何特征匹配方法

李健1,杨祥如1,何斌2   

  1. (陕西科技大学电气与信息工程学院 西安710021)1
    (同济大学电气与信息工程学院 上海201804)2
  • 收稿日期:2018-06-21 出版日期:2019-07-15 发布日期:2019-07-15
  • 作者简介:李 健(1975-),男,教授,硕士生导师,主要研究方向为计算机视觉、计算机图形学,E-mail:498009028@qq.com;杨祥如(1993-),男,硕士生,主要研究方向为计算机视觉、计算机图形学;何 斌(1975-),男,博士,教授,博士生导师,主要研究方向为新型机器人动力学及智能控制,E-mail:hebin@tongji.edu.cn(通信作者)。
  • 基金资助:
    国家自然科学基金项目(51538009),陕西省工业攻关项目(2015GY044)资助

Geometric Features Matching with Deep Learning

LI Jian1,YANG Xiang-ru1,HE Bin2   

  1. (School of Electrical and Information Engineering,Shaanxi University of Science & Technology,Xi’an 710021,China)1
    (School of Electrical and Information Engineering,Tongji University,Shanghai 201804,China)2
  • Received:2018-06-21 Online:2019-07-15 Published:2019-07-15

摘要: Kinect等深度相机采集的三维数据往往存在噪音、低分辨率等问题,导致两帧点云的局部几何特征匹配一直面临挑战。目前多采用基于特征直方图的方法解决这一问题,但其计算量较大,且对场景旋转平移的要求较为严格。文中提出了一种基于数据驱动的方法,首先从大量重建好的RGB-D数据集中,通过自监督的深度学习方法构建能够描述三维数据几何特征的模型;然后利用基于KD-Tree的K近邻算法(KNN)得到两部分点云的特征对应点,通过RANSAC剔除误匹配点对;最后通过得到的较准确的位置关系估计两帧点云的几何变换,从而完成配准。基于斯坦福大学点云库中的模型以及真实环境下Kinect采集到的大卫石膏像模型的配准和比较实验表明,所提方法不仅可以提取未知物体的局部几何特征进行配准,还可以较好地应对空间角度变换大的情况。

关键词: KD-Tree, 大角度变换, 点云特征配准, 深度学习, 自监督

Abstract: Matching local geometric features on real-world depth images is a challenging task due to the noisy and low-resolution of 3D scan captured by depth cameras like Kinect.At present,most of the solutions to this problem are based on the feature histogram method,which requires a large amount of calculation and strict requirements on the rotation of the scene.This paper proposed a method based on data-driven.From a large number of well-reconstructed RGB-D data sets,a self-supervised deep learning method is used to construct a model that can describe the geometric correspondence between three-dimensional data.Then,corresponding approximate points of two parts of the point cloud are botained by using KD-Tree-based K Nearest Neighbor (KNN) algorithm.Through removing erroneous matching point pairs using RANSAC,a relatively accurate set of feature point pairs is obtained by estimating the geometric transformation.By regis-tering and comparing the models in the Stanford University point cloud library and the David plaster model collected in the real environment,the experiments show that the proposed method can not only extract the local geometric features of unknown objects for registration,but also show good performance when dealing with large changes in spatial angle.

Key words: Deep learning, KD-Tree, Large angle transformation, Point cloud feature registration, Self-supervised

中图分类号: 

  • TP391
[1]RUSU R B,BLODOW N,BEETZ M.Fast point feature histograms (FPFH) for 3D registration[C]∥IEEE International Conference on Robotics and Automation.Kobe,Japan:IEEE Press,2009:3212-3217.
[2]MA D H,LIU G Z.Improved Method of Point Cloud Registration Based on FPFH Feature[J].Computer and Modernization,2017(11):46-50.(in Chinese)
马大贺,刘国柱.改进的基于FPFH特征配准点云的方法[J].计算机与现代化,2017(11):46-50.
[3]BESL P J.A method for registration 3D shapes[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(2):193-200.
[4]ZHAO F Q,ZHOU M Q.Improved Probability Iterative Closest Point Registration Algorithm [J].Journal of Graphics,2017,38(1):15-22.(in Chinese)
赵夫群,周明全.改进的概率迭代最近点配准算法[J].图学学报,2017,38(1):15-22.
[5]AIGER D,MITRA N J,COHEN-OR D.4-points congruent sets for robust pairwise surface registration[J].Acm Transactions on Graphics,2008,27(3):1-10.
[6]YU W L,ZHOU M Q,SHUI W Y,et al.Automatic Registration Method Based on Curvature[J].Journal of System Simulation,2015,27(10):2374-2379.(in Chinese)
余文利,周明全,税午阳,等.基于曲率的点云自动配准方法[J].系统仿真学报,2015,27(10):2374-2379.
[7]MELLADO N,AIGER D,MITRA N J.Super 4PCS Fast Global Pointcloud Registration via Smart Indexing[J].Computer Graphics Forum,2015,33(5):205-215.
[8]WU Z,SONG S,KHOSLA A,et al.3D ShapeNets:A deep representation for volumetric shapes[C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Boston,MA,USA,2014.
[9]ZENG A,SONG S,NIEBNER M,et al.3DMatch:Learning Local Geometric Descriptors from RGB-D Reconstructions[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2017:199-208.
[10]GUO K,ZOU D,CHEN X.3D Mesh Labeling via Deep Convolutional Neural Networks[J].Acm Transactions on Graphics,2015,35(1):1-12.
[11]ANGELO L D,GIACCARI L.An efficient algorithm for the nearest neighbourhood search for point clouds[J].International Journal of Computer Science Issues,2011,8(5):1-11.
[12]LEBEDA K,MATAS J,CHUM O.Fixing Locally Optimized RANSAC Full Experimental Evaluation[C]∥British Machine Vision Conference.Guildford,UK,2012:1-11.
[13]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks[C]∥International Conference on Neural Information Processing Systems.Curran Associates Inc.2012:1097-1105.
[14]VALENTIN J,DAI A,NIEβNER M,et al.Learning to Navigate the Energy Landscape[C]∥IEEE 2016 Fourth InternationalConference on 3D Vision (3DV).Stanford,CA,USA,2016:323-332.
[15]SHOTTON J,GLOCKER B,ZACH C,et al.Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2013:2930-2937.
[16]XIAO J,OWENS A,TORRALBA A.SUN3D:A Database of Big Spaces Reconstructed Using SfM and Object Labels[C]∥IEEE International Conference on Computer Vision.IEEE Computer Society,2013:1625-1632.
[17]The Stanford 3D Scanning Repository[EB/OL].(2014-08-19).www.graphics.st-anford.edu.
[1] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[2] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[3] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[4] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[5] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[6] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[7] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[8] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[9] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[10] 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木.
中文预训练模型研究进展
Advances in Chinese Pre-training Models
计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[11] 周慧, 施皓晨, 屠要峰, 黄圣君.
基于主动采样的深度鲁棒神经网络学习
Robust Deep Neural Network Learning Based on Active Sampling
计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[12] 杜航原, 李铎, 王文剑.
一种面向电商网络的异常用户检测方法
Method for Abnormal Users Detection Oriented to E-commerce Network
计算机科学, 2022, 49(7): 170-178. https://doi.org/10.11896/jsjkx.210600092
[13] 苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫.
小样本雷达辐射源识别的深度学习方法综述
Survey of Deep Learning for Radar Emitter Identification Based on Small Sample
计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[14] 王君锋, 刘凡, 杨赛, 吕坦悦, 陈峙宇, 许峰.
基于多源迁移学习的大坝裂缝检测
Dam Crack Detection Based on Multi-source Transfer Learning
计算机科学, 2022, 49(6A): 319-324. https://doi.org/10.11896/jsjkx.210500124
[15] 楚玉春, 龚航, 王学芳, 刘培顺.
基于YOLOv4的目标检测知识蒸馏算法研究
Study on Knowledge Distillation of Target Detection Algorithm Based on YOLOv4
计算机科学, 2022, 49(6A): 337-344. https://doi.org/10.11896/jsjkx.210600204
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!