Computer Science

Computer Science ›› 2021, Vol. 48 ›› Issue (6A): 51-56.doi: 10.11896/jsjkx.200500122

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Image Recognition for Building Components Based on Convolutional Neural Network

XIONG Zhao-yang, WANG Ting   

  1. School of Civil Engineering,Nanchang Hangkong University,Nanchang 330063,China
  • Online:2021-06-10 Published:2021-06-17
  • About author:XIONG Zhao-yang,born in 1996,master.His main research interests include deep learning and intelligent construction.
    WANG Ting,born in 1975,Ph.D,associate professor.Her main research interests include BIM and intelligent construction.
  • Supported by:
    National Natural Science Foundation of China (51968051).

PDF (PC)

1281

Abstract: It is necessary to convert the point cloud data into theRGB-D images of building and classify the images,when using the point cloud data obtained by 3D laser scanner to generate BIM model for a large number of existing buildings.In this paper,based on the deep learning algorithm,a method of building components image recognition employing the convolution neural network is proposed by using the transfer learning theory to dealing with the classification problem of interior building components image such as doors and windows.First of all,the VGG16 with weight parameters trained in Imagenet is used as the image recognition neural network.In addition,the network is optimized by adding Dropout layer,L2 regularization and using Fine-tune operation to improve the recognition accuracy of the network.The experimental results show that the average recognition accuracy of the model optimized by Fine-tune is 95.4%,which is about 5.1% higher than that of the model without optimization.

Key words: Building components, Convolutional neural network, Image recognition, Transfer learning

CLC Number: 

  • TP391
[1] BRILAKIS I,LOURAKIS R,SACKS R,et al.Toward automated generation of parametric BIMs based on hybrid video and laser scanning data [J].Advanced Engineering Informatics,2010,24(4):456-465.
[2] CORTES C,VAPNIK V N.Support Vector Networks [J].Machine Learning,1995,20(3):273-297.
[3] WANG C F,XIAO S B.Study of Image Classification Based on SVM[J].Computer and Digital Engineering,2006,34(8):74-76,81.
[4] CHEN P H,SHEN H K,LEI C Y,et al.Support-vector-machine-based method for automated steel bridge rust assessment [J].Automation in Construction,2012,23:9-19.
[5] LOWE D G.Object Recognition from Local Scale-Invariant Fea-tures[C]//International Conference on Computer Vision.1999.
[6] YU K,JIA L,CHEN Y Q,et al.Deep Learning:Yesterday,Today,Tomorrow[J].Journal of Computer Researchand Development,2013,50(9):1799-1804.
[7] HINTON E G.Reducing the Dimensionality of Data with Neural Networks [J].Science,2006,313(5786):504-507.
[8] KRIZHEVSKY A,SUTSKEVER I,HINTON G.ImageNetClassification with Deep Convolutional Neural Networks [J].Advances in Neural Information Processing Systems,2012,25(2).
[9] CHA Y J,CHOI W,BÜYÜKZTÜRK O.Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].Computer-aided Civil & Infrastructure Engineering,2017,32(5):361-378.
[10] HUANG H W,LI Q T.Image recognition for water leakage in shield tunnel based on deep learning [J].Chinese Journal of Rock Mechanicsand Engineering,2017,32(5):361-378.
[11] LIU W T,LI S H,QIN Y C.Automatic Building Roof Extraction with Fully Convolutional Neural Network [J].Journal of Geo-Information Science,2018,20(11):1562-1570.
[12] YI Y K,ZHANG Y,MYUNG J.House style recognition using deep convolutional neural network [J].Automation in Construction,2020,118:103-307.
[13] SIMONYAN K,ZISSERMAN A.Very Deep Convolutional Networks for Large-Scale Image Recognition [J].arXiv:1409.1556.
[14] DENG J,DONG W,SOCHER R,et al.ImageNet:a Large-Scale Hierarchical Image Database[C]//2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2009).Miami,Florida,USA,2009:20-25.
[15] ATKINSON G A,ZHANG W,HANSEN M F,et al.Image segmentation of underfloor scenes using a mask regions convolutional neural network with two-stage transfer learning [J].Automation in Construction,2020,113:103-118.
[16] GAO Y,MOSALAM K M.Deep Transfer Learning for Image-Based Structural Damage Recognition [J].Computer-Aided Civil and Infrastructure Engineering,2018,33(9):748-768.
[17] GLOROT X,BORDES A,BENGIO Y.Deep Sparse RectifierNeural Networks [C]//14th International Conference on Artificial Intelligence and Statistics (AISTATS).Fort Lauderdale,FL,USA,2011.
[18] SAINATH T N,MOHAMED A R,KINGSBURY B,et al.Deep convolutional neural networks for LVCSR[C]//2013 IEEE International Conference on Acoustics,Speech and Signal Proces-sing (ICASSP).IEEE,2013.
[19] SRIVASTAVA N,HINTON G,KRIZHEVSKY A,et al.Dropout:a simple way to prevent neural networks from overfitting [J].J Mach Learn Res,2014,15(1):1929-1958.
[20] KINGMA D P,BA J.Adam A Method for Stochastic Optimization [J].arXiv:abs1412.6980.
[21] BAKHODA A,YUAN G L,FUNG W W L,et al.Analyzing CUDA workloads using a detailed GPU simulator[C]//2009 ISPASS 2009 IEEE International Symposium on Performance Analysis of Systems and Software.2009.
[22] ABADI M,AGARWAL A,BARHAM P,et al.TensorFlow:Large-Scale Machine Learning on Heterogeneous Distributed Systems [J].arXiv:1603.04467,2016.
[23] SONG S,LICHTENBERG S P,XIAO J.SUN RGB-D:A RGB-D scene understanding benchmark suite[C]//IEEE Conference on Computer Vision & Pattern Recognition(CVPR).IEEE,2015:567-576.
[24] GUPTA S,GIRSHICK R,ARBELÁEZ P,et al.Learning Rich Features from RGB-D Images for Object Detection and Segmentation [C]//ECCV 2014.2014:345-360.
[25] LIU C,XU X J.RGB-D image classification based on convolutional neural network[J].Electronic Design Engineering,2018,26(24):159-163.
[1] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[2] FANG Yi-qiu, ZHANG Zhen-kun, GE Jun-wei. Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning [J]. Computer Science, 2022, 49(8): 70-77.
[3] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[4] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[5] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[6] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
[7] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[8] WANG Jun-feng, LIU Fan, YANG Sai, LYU Tan-yue, CHEN Zhi-yu, XU Feng. Dam Crack Detection Based on Multi-source Transfer Learning [J]. Computer Science, 2022, 49(6A): 319-324.
[9] YANG Yue, FENG Tao, LIANG Hong, YANG Yang. Image Arbitrary Style Transfer via Criss-cross Attention [J]. Computer Science, 2022, 49(6A): 345-352.
[10] YANG Jian-nan, ZHANG Fan. Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure [J]. Computer Science, 2022, 49(6A): 353-357.
[11] ZHANG Jia-hao, LIU Feng, QI Jia-yin. Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer [J]. Computer Science, 2022, 49(6A): 370-377.
[12] WANG Jian-ming, CHEN Xiang-yu, YANG Zi-zhong, SHI Chen-yang, ZHANG Yu-hang, QIAN Zheng-kun. Influence of Different Data Augmentation Methods on Model Recognition Accuracy [J]. Computer Science, 2022, 49(6A): 418-423.
[13] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[14] WU Zi-bin, YAN Qiao. Projected Gradient Descent Algorithm with Momentum [J]. Computer Science, 2022, 49(6A): 178-183.
[15] ZHAO Zheng-peng, LI Jun-gang, PU Yuan-yuan. Low-light Image Enhancement Based on Retinex Theory by Convolutional Neural Network [J]. Computer Science, 2022, 49(6): 199-209.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.