Computer Science ›› 2019, Vol. 46 ›› Issue (1): 278-284.doi: 10.11896/j.issn.1002-137X.2019.01.043

• Graphics ,Image & Pattern Recognition • Previous Articles     Next Articles

3D Model Retrieval Based on Deep Convolution Neural Network

LIU Zhi, LI Jiang-chuan   

  1. (College of Computer Science and Technology,Zhejiang University of Technology,Hangzhou 310023,China)
  • Received:2017-11-30 Online:2019-01-15 Published:2019-02-25

Abstract: In order to make use of 3D model data set for feature self-learning more effectrively,this paper proposed a 3D model retrieval method,in which the natural images are as input sources,a better view set of 3D model is as basis,and the depth features obtained through training deep convolutional neural networks are applied for retrieval.Firstly,the 3D model views are extracted from multiple viewpoints and the optimal view is selected according to the order of gray entropy.Secondly,the view set is trained through deep convolution neural network,the depth features of the optimal view are extracted and its dimension is reduced.At the same time,edge contouring is extracted for the input natural image and a set of 3D models is gotten after similarity matching.Finally,according to the ratio of the total number of similar models to the length of the search list in the retrieval result,the retrieval list is reordered and the final result will be gained.Experimental results show that the algorithm can effectively use depth convolution neural network to extract the depth feature of the view of the 3D model,meanwhile reduce the difficulty of obtaining the input source,and improve the retrieval efficiency effectively.

Key words: 3D model retrieval, Deep learning, Feature extraction, View selection

CLC Number: 

  • TP391
[1]SCHMIDHUBER J.Deep learning in neural networks:an overview[J].Neural Networks the Official Journal of the International Neural Network Society,2014,61(1):85-117.<br /> [2]SUN Z Y,LU C X,SHI Z Z,et al.Research and Progress of Deep Learning [J].Computer Science,2016,43(2):1-8.(in Chinese)<br /> 孙志远,鲁成祥,史忠植,等.深度学习研究与进展[J].计算机科学,2016,43(2):1-8.<br /> [3]LUO W,SCHWING A G,URTASUN R.Efficient Deep Learning for Stereo Matching[C]//IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2016:5695-5703.<br /> [4]ZHANG J,BAI C,NEZAN J F,et al.Joint motion model for local stereo video-matching method[J].Optical Engineering,2015,54(12):123108.<br /> [5]SHI M,XIE F,ZI Y,et al.Cloud detection of remote sensing images by deep learning[C]//Geoscience and Remote Sensing Symposium.IEEE,2016:701-704.<br /> [6]ZHANG J,SHANG J,ZHANG G.Verification for Different Contrail Parameterizations Based on Integrated Satellite Observation and ECMWF Reanalysis Data[J].Advances in Meteoro-logy,2017,2017(1):1-11.<br /> [7]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks[C]//International Conference on Neural Information Processing Systems.Curran Associates Inc.,2012:1097-1105.<br /> [8]SIMONYAN K,ZISSERMAN A.Very Deep Convolutional Networks for Large-Scale Image Recognition[EB/OL].https://cn.arXiv.org/abs/1409.1556.2014.<br /> [9]ALZU’BI A,AMIRA A,RAMZAN N.Content Based Image Retrieval with Compact Deep Convolutional Features[J].Neurocomputing,2017,249(2):95-105.<br /> [10]SALVADOR A,GIROINIETO X,MARQUES F,et al.Faster R-CNN Features for Instance Search[C]//IEEE Conference on Computer Vision and Pattern Recognition Workshops.IEEE Computer Society,2016:394-401.<br /> [11]LIU Y,PAN Y,XIA R K,et al.FP-CNNH:A Fast Image Hashing Algorithm Based on Depth Convolution Neural Network [J].Computer Science,2016,43(9):39-46.(in Chinese)<br /> 刘冶,潘炎,夏榕楷,等.FP-CNNH:一种基于深度卷积神经网络的快速图像哈希算法[J].计算机科学,2016,43(9):39-46.<br /> [12]ZHU Z,WANG X,BAI S,et al.Deep Learning Representation using Autoencoder for 3D Shape Retrieval[J].Neurocomputing,2016,204(C):41-50.<br /> [13]LI X X,CAO Q,WEI S.3D object retrieval based on multiview convolutional neural networks[J].Multimedia Tools & Applications,2017,76(19):20111-201214.<br /> [14]WANG F,KANG L,LI Y.Sketch-based 3d shape retrieval using convolutional neural networks//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:1875-1883.<br /> [15]DECARLO D,FINKELSTEIN A,RUSINKIEWICZ S,et al.Suggestive contours for conveying shape[C]//ACM Siggraph.ACM,2003:848-855. <br /> [16]DING L,GOSHTASBY A.On the Canny edge detector[J].Pattern Recognition,2001,34(3):721-725.<br /> [17]SANG M Y,SCHERER M,SCHRECK T,et al.Sketch-based 3D model retrieval using diffusion tensor fields of suggestive contours[C]//International Conference on Multimedea 2010.Firenze,Italy,DBLP,2010:193-200.<br /> [18]LI B,LU Y,JOHAN H.Sketch-based 3D model retrieval by viewpoint entropy based adaptive view clustering[C]//Eurographics Workshop on 3d Object Retrieval.Eurographics Association,2013:49-56.<br /> [19]HONG Y,KIM J,HONG Y,et al.A 2D-View Depth Image and CNN-Based 3D Model Identification Method[J].Applied Scien-ces,2017,7(10):988-1001.<br /> [20]CLEVERT D,UNTERTHINER T,HOCHREITER S.Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)[EB/OL].https://cnarXiv.org/abs/1511.07289.2015.<br /> [21]LI B,LU Y,LI C,et al.A comparison of 3D shape retrieval methods based on a large-scale benchmark supporting multimodal queries[J].Computer Vision and Image Understanding,2015,131(1):1-27.<br /> [22]LI B,LU Y,LI C,et al.Shrec’14 track:extended large scale sketch-based 3D shape retrieval[C]//Eurographics Workshop on 3D Object Retrieval.2014.<br /> [23]LIU Z,YIN S C,PAN X,et al.3D model retrieval based on feature lines [J].Journal of Computer-Aided Design & Computer Graphics,2016,28(9):1512.(in Chinese)<br /> 刘志,尹世超,潘翔,等.基于特征线条的三维模型检索方法[J].计算机辅助设计与图形学学报,2016,28(9):1512.<br /> [24]HUA S,JIANG Q,ZHONG Q.3D Model Retrieval Based on Multi-View SIFT Feature[M]//Communication Systems and Information Technology.Springer Berlin Heidelberg,2011:163-169.
[1] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[3] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[4] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[5] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[6] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[8] ZHANG Yuan, KANG Le, GONG Zhao-hui, ZHANG Zhi-hong. Related Transaction Behavior Detection in Futures Market Based on Bi-LSTM [J]. Computer Science, 2022, 49(7): 31-39.
[9] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[10] ZENG Zhi-xian, CAO Jian-jun, WENG Nian-feng, JIANG Guo-quan, XU Bin. Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism [J]. Computer Science, 2022, 49(7): 106-112.
[11] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[12] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[13] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[14] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[15] WANG Jun-feng, LIU Fan, YANG Sai, LYU Tan-yue, CHEN Zhi-yu, XU Feng. Dam Crack Detection Based on Multi-source Transfer Learning [J]. Computer Science, 2022, 49(6A): 319-324.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!