Computer Science ›› 2019, Vol. 46 ›› Issue (7): 274-279.doi: 10.11896/j.issn.1002-137X.2019.07.042

• Graphics, Image & Pattern Recognition • Previous Articles     Next Articles

Geometric Features Matching with Deep Learning

LI Jian1,YANG Xiang-ru1,HE Bin2   

  1. (School of Electrical and Information Engineering,Shaanxi University of Science & Technology,Xi’an 710021,China)1
    (School of Electrical and Information Engineering,Tongji University,Shanghai 201804,China)2
  • Received:2018-06-21 Online:2019-07-15 Published:2019-07-15

Abstract: Matching local geometric features on real-world depth images is a challenging task due to the noisy and low-resolution of 3D scan captured by depth cameras like Kinect.At present,most of the solutions to this problem are based on the feature histogram method,which requires a large amount of calculation and strict requirements on the rotation of the scene.This paper proposed a method based on data-driven.From a large number of well-reconstructed RGB-D data sets,a self-supervised deep learning method is used to construct a model that can describe the geometric correspondence between three-dimensional data.Then,corresponding approximate points of two parts of the point cloud are botained by using KD-Tree-based K Nearest Neighbor (KNN) algorithm.Through removing erroneous matching point pairs using RANSAC,a relatively accurate set of feature point pairs is obtained by estimating the geometric transformation.By regis-tering and comparing the models in the Stanford University point cloud library and the David plaster model collected in the real environment,the experiments show that the proposed method can not only extract the local geometric features of unknown objects for registration,but also show good performance when dealing with large changes in spatial angle.

Key words: Deep learning, KD-Tree, Large angle transformation, Point cloud feature registration, Self-supervised

CLC Number: 

  • TP391
[1]RUSU R B,BLODOW N,BEETZ M.Fast point feature histograms (FPFH) for 3D registration[C]∥IEEE International Conference on Robotics and Automation.Kobe,Japan:IEEE Press,2009:3212-3217.
[2]MA D H,LIU G Z.Improved Method of Point Cloud Registration Based on FPFH Feature[J].Computer and Modernization,2017(11):46-50.(in Chinese)
[3]BESL P J.A method for registration 3D shapes[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(2):193-200.
[4]ZHAO F Q,ZHOU M Q.Improved Probability Iterative Closest Point Registration Algorithm [J].Journal of Graphics,2017,38(1):15-22.(in Chinese)
[5]AIGER D,MITRA N J,COHEN-OR D.4-points congruent sets for robust pairwise surface registration[J].Acm Transactions on Graphics,2008,27(3):1-10.
[6]YU W L,ZHOU M Q,SHUI W Y,et al.Automatic Registration Method Based on Curvature[J].Journal of System Simulation,2015,27(10):2374-2379.(in Chinese)
[7]MELLADO N,AIGER D,MITRA N J.Super 4PCS Fast Global Pointcloud Registration via Smart Indexing[J].Computer Graphics Forum,2015,33(5):205-215.
[8]WU Z,SONG S,KHOSLA A,et al.3D ShapeNets:A deep representation for volumetric shapes[C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Boston,MA,USA,2014.
[9]ZENG A,SONG S,NIEBNER M,et al.3DMatch:Learning Local Geometric Descriptors from RGB-D Reconstructions[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2017:199-208.
[10]GUO K,ZOU D,CHEN X.3D Mesh Labeling via Deep Convolutional Neural Networks[J].Acm Transactions on Graphics,2015,35(1):1-12.
[11]ANGELO L D,GIACCARI L.An efficient algorithm for the nearest neighbourhood search for point clouds[J].International Journal of Computer Science Issues,2011,8(5):1-11.
[12]LEBEDA K,MATAS J,CHUM O.Fixing Locally Optimized RANSAC Full Experimental Evaluation[C]∥British Machine Vision Conference.Guildford,UK,2012:1-11.
[13]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks[C]∥International Conference on Neural Information Processing Systems.Curran Associates Inc.2012:1097-1105.
[14]VALENTIN J,DAI A,NIEβNER M,et al.Learning to Navigate the Energy Landscape[C]∥IEEE 2016 Fourth InternationalConference on 3D Vision (3DV).Stanford,CA,USA,2016:323-332.
[15]SHOTTON J,GLOCKER B,ZACH C,et al.Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2013:2930-2937.
[16]XIAO J,OWENS A,TORRALBA A.SUN3D:A Database of Big Spaces Reconstructed Using SfM and Object Labels[C]∥IEEE International Conference on Computer Vision.IEEE Computer Society,2013:1625-1632.
[17]The Stanford 3D Scanning Repository[EB/OL].(2014-08-19)
[1] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[2] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[3] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[4] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[5] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[6] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[8] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[9] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[10] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[11] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[12] DU Hang-yuan, LI Duo, WANG Wen-jian. Method for Abnormal Users Detection Oriented to E-commerce Network [J]. Computer Science, 2022, 49(7): 170-178.
[13] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[14] WANG Jun-feng, LIU Fan, YANG Sai, LYU Tan-yue, CHEN Zhi-yu, XU Feng. Dam Crack Detection Based on Multi-source Transfer Learning [J]. Computer Science, 2022, 49(6A): 319-324.
[15] CHU Yu-chun, GONG Hang, Wang Xue-fang, LIU Pei-shun. Study on Knowledge Distillation of Target Detection Algorithm Based on YOLOv4 [J]. Computer Science, 2022, 49(6A): 337-344.
Full text



No Suggested Reading articles found!