Computer Science ›› 2021, Vol. 48 ›› Issue (4): 192-196.doi: 10.11896/jsjkx.200100048

• Computer Graphics & Multimedia • Previous Articles     Next Articles

3D Point Cloud Shape Completion GAN

ZHAO Xin-can, CHANG Han-xing, JIN Ren-biao   

  1. School of Information Engineering,Zhengzhou University,Zhengzhou 450001,China
  • Received:2020-06-24 Revised:2020-06-03 Online:2021-04-15 Published:2021-04-09
  • About author:ZHAO Xin-can,born in 1972,Ph.D,associate professor.His main research interests include virtual reality(VR) and augmented reality(AR).
  • Supported by:
    Aeronautical Science Foundation of China (2018ZC41002).

Abstract: In the real scanning environment,due to the occlusion of line of sight or improper operation of technicians,the actual point cloud model has incomplete shape.The incompleteness of point cloud model has a serious impact on subsequent applications.Therefore,this paper proposes a 3D point cloud shape completion generative adversarial networks to complete the shape completion of point cloud model.The point cloud reconstruction part of the network combines the T-Net structure used for data alignment in PointNet with the 3D point cloud AutoEncoder network to complete the prediction and fill in the missing data.The discriminator uses the Encoder part of the 3D point cloud AutoEncoder to distinguish the completed 3D point cloud data from the real 3D point cloud data.Finally,in the ShapeNet trained the above network structure,the trained network model is verified and compared with other benchmark methods qualitatively.From the experimental results,it can be seen that the 3D point cloud shape completion generation adversarial network can complete the point cloud model with missing data into a complete 3D point cloud.In ShapeNet’s three sub-datasets chair,table,and bed,compared with the method based on 3D point cloud AutoEncoder,the F1 score is improved by 3.0%,3.3% and 3.1%,and compared with the method based on the voxel 3D-EPN method,the F1 score is increased by 9.9%,5.8%,and 4.3%,respectively.

Key words: 3D point cloud, AutoEncoder, Generative adversarial network, Shape completion

CLC Number: 

  • TP391
[1]LEONG K F,CHUA C K,NG Y M.A study of stereolithography file errors and repair.Part 1.Generic solution[J].The International Journal of Advanced Manufacturing Technology,1996,12(6):407-414.
[2]LEONG K F,CHUA C K,NG Y M.A study of stereolithography file errors and repair.Part 2.Special cases[J].The International Journal of Advanced Manufacturing Technology,1996,12(6):415-422.
[3]PFEIFLE R,SEIDEL H P.Triangular B-splines for Blending & Filling of Polygonal Holes[C]//Graphics Inter-face.1996:186-193.
[4]ISHIGAMI G,OTSUKI M,KUBOTA T.Path planning andnavigation framework for a planetary exploration rover using a laser range finder[C]//Field and Service Robotics.Springer,Berlin,Heidelberg,2014:431-447.
[5]YANG R,FENG Y Q,YUAN X J.Restora-tion of Fragmentary 3D Models Using Existing Models[J].Journal of Com-puter-Aided Design & Computer Gra-phics,2015(1):98-105.
[6]SUNG M,KIM V G,ANGST R,et al.Data-driven structural priors for shape completion[J].ACM Transactions on Graphics (TOG),2015,34(6):1-11.
[7]ROCK J,GUPTA T,THORSEN J,et al.Completing 3d object shape from one depth image[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:2484-2493.
[8]LI D,SHAO T,WU H,et al.Shape com-pletion from a single rgbd image[J].IEEE Transactions on Visualization and Computer Graphics,2016,23(7):1809-1822.
[9]WU J,ZHANG C,XUE T,et al.Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling[C]//Advances in Neural Information Processing Systems.2016:82-90.
[10]WANG W,HUANG Q,YOU S,et al.Shape inpainting using 3d generative adver-sarial network and recurrent convolu-tional networks[C]//Proceedings of the IEEE InternationalConfe-rence on Computer Vision.2017:2298-2306.
[11]YU C,WANG Y.3D-Scene-GAN:Three-dimensional Scene Reconstruction with Generative Adversarial Networks[C]//ICLR (Workshop).2018:1-4.
[12]DAI A,RITCHIE D,BOKELOH M,et al.Scancomplete:Large-scale scene com-pletion and semantic segmentation for 3d scans[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:4578-4587.
[13]QI C R,SU H,MO K,et al.Pointnet:Deep learning on pointsets for 3d classification and segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:652-660.
[14]QI C R,YI L,SU H,et al.Pointnet++:Deep hierarchical feature learning on point sets in a metric space[C]//Advances in Neural Information Processing Systems.2017:5099-5108.
[15]ACHLIOPTAS P,DIAMANTI O,MITLIAGKAS I,et al.Learning representations and generative models for 3d point clouds[J].arXiv:1707.02392.
[16]CHANG A X,FUNKHOUSER T,GUIBAS L,et al.Shapenet:An information-rich 3d model repository[J].arXiv:1512.03012,2015.
[17]ALDOMA A,MARTON Z C,TOMBARI F,et al.Tutorial:Point cloud library:Three-dimensional object recognition and 6 dof pose estimation[J].IEEE Robotics & Automation Magazine,2012,19(3):80-91.
[18]IOFFE S,SZEGEDY C.Batch normaliza-tion:Accelerating deep network training by reducing internal covariate shift[J].arXiv:1502.03167.
[19]CHEN X,CHEN B,MITRA N J.Unpaired Point Cloud Completion on Real Scans using Adversarial Training[J].arXiv:1904.00069,2019.
[20]DAI A,RUIZHONGTAI QI C,NIEβNER M.Shape comple-tion using 3d-encoder-predictor cnns and shape synthesis[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:5868-5877.
[21]YUAN W,KHOT T,HELD D,et al.Pcn:Point completion network[C]//2018 International Conference on 3D Vision (3DV).IEEE,2018:728-737.
[1] ZHANG Jia, DONG Shou-bin. Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer [J]. Computer Science, 2022, 49(9): 41-47.
[2] WANG Guan-yu, ZHONG Ting, FENG Yu, ZHOU Fan. Collaborative Filtering Recommendation Method Based on Vector Quantization Coding [J]. Computer Science, 2022, 49(9): 48-54.
[3] LIU Xin, WANG Jun, SONG Qiao-feng, LIU Jia-hao. Collaborative Multicast Proactive Caching Scheme Based on AAE [J]. Computer Science, 2022, 49(9): 260-267.
[4] YANG Wen-kun, YUAN Xiao-pei, CHEN Xiao-feng, GUO Rui. Spatial Multi-feature Segmentation of 3D Lidar Point Cloud [J]. Computer Science, 2022, 49(8): 143-149.
[5] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[6] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[7] XU Guo-ning, CHEN Yi-peng, CHEN Yi-ming, CHEN Jin-yin, WEN Hao. Data Debiasing Method Based on Constrained Optimized Generative Adversarial Networks [J]. Computer Science, 2022, 49(6A): 184-190.
[8] YIN Wen-bing, GAO Ge, ZENG Bang, WANG Xiao, CHEN Yi. Speech Enhancement Based on Time-Frequency Domain GAN [J]. Computer Science, 2022, 49(6): 187-192.
[9] XU Hui, KANG Jin-meng, ZHANG Jia-wan. Digital Mural Inpainting Method Based on Feature Perception [J]. Computer Science, 2022, 49(6): 217-223.
[10] GAO Zhi-yu, WANG Tian-jing, WANG Yue, SHEN Hang, BAI Guang-wei. Traffic Prediction Method for 5G Network Based on Generative Adversarial Network [J]. Computer Science, 2022, 49(4): 321-328.
[11] DOU Zhi, WANG Ning, WANG Shi-jie, WANG Zhi-hui, LI Hao-jie. Sketch Colorization Method with Drawing Prior [J]. Computer Science, 2022, 49(4): 195-202.
[12] HAN Jie, CHEN Jun-fen, LI Yan, ZHAN Ze-cong. Self-supervised Deep Clustering Algorithm Based on Self-attention [J]. Computer Science, 2022, 49(3): 134-143.
[13] LI Si-quan, WAN Yong-jing, JIANG Cui-ling. Multiple Fundamental Frequency Estimation Algorithm Based on Generative Adversarial Networks for Image Removal [J]. Computer Science, 2022, 49(3): 179-184.
[14] SHI Da, LU Tian-liang, DU Yan-hui, ZHANG Jian-ling, BAO Yu-xuan. Generation Model of Gender-forged Face Image Based on Improved CycleGAN [J]. Computer Science, 2022, 49(2): 31-39.
[15] LI Jian, GUO Yan-ming, YU Tian-yuan, WU Yu-lun, WANG Xiang-han, LAO Song-yang. Multi-target Category Adversarial Example Generating Algorithm Based on GAN [J]. Computer Science, 2022, 49(2): 83-91.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!