Computer Science ›› 2018, Vol. 45 ›› Issue (11A): 238-243.

• Pattem Recognition & Image Processing • Previous Articles     Next Articles

Algorithm of Multi-layer Forward Artificial Neural Network for Image Classification

GU Zhe-bin, CAO Fei-long   

  1. College of Sciences,China Jiliang University,Hangzhou 310018,China
  • Online:2019-02-26 Published:2019-02-26

Abstract: The input of traditional artificial neural network is in vector form,but the image is represented by matrix.Therefore,in the process of image processing,the image will be inputted into the neural network in vector form,which will destroy the structure information of image,and thus affect the effect of image processing.In order to improve the ability of network on image processing,the multilayer feedforward neural networks with matrix inputs are introducedbased on the idea and method of deep learning.At the same time,the traditional back-propagation algorithm (BP) is used to train the network,and the training process and training algorithm are given.After a lot of experiments,the network structure with good performance were determined,and the numerical experiments were carried out on the USPS handwritten digital data set.The experimental results show that the proposed multilayer network has better classification results than the single hidden layer feed forward neural network with matrix input (2D-BP).In addition,to deal with the problem of color image classification,this paper provided an effective and feasible method,the new 2D-BP network,to deal with it

Key words: Gradient optimization, Image classification, Learning algorithm, Multilayer feedforward neural networks

CLC Number: 

  • TN911.71
[1]高隽,谢昭.图像理解理论与方法 [M].北京:科学出版社,2009.
[2]RICHARDS L E.Principal Component Analysis [J].Journal of Marketing Research,1988,38(22):41-64.
[3]STONE J.Principal Component Analysis and Factor Analysis[M].MIT Press,2004:129-135.
[4]LU J,PLATANIOTIS K N,VENETSANOPOULOS A N.Face recognition using LDA-based algorithms [J].IEEE Transactions on Neural Networks,2003,14(1):195-200.
[5]ZHENG W S,LAI J H,YUEN P C.GA-fisher:A new LDA-based face recognition algorithm with selection of principal components[J].IEEE Transactions on Systems Man & Cybernetics Part B,2005,35(5):1065-1078.
[6]VAPNIK V N.The nature of statistical learning theory[M].New York:Springer,2000.
[7]SHAKHNAROVICH G,DARRELL T,INDYK P.Nearest- neighbor methods in learning and vision[J].Pattern Analysis and Applications,2008,11(2):221-222.
[8]HORNIK K,STINCHCOMBE M,WHITE H.Multilayer feedforward networks are universal approximators[J].Neural Networks,1989,2(5):359-366.
[9]DAI K,ZHAO J,CAO F.A novel algorithm of extended neural networks for image recognition [J].Engineering Applications of Artificial Intelligence,2015,42(1):57-66.
[10]YAN X,YAN X,ZHANG L,et al.Feature extraction based on fuzzy 2DLDA[J].Neurocomputing,2010,73(10-12):1556-1561.
[11]SANGUANSAT P,ASDORNWISED W,JITAPUNKUL S,et al.Two-Dimensional Linear Discriminant Analysis of Principle Component Vectors for Face Recognition[J].IEICE-Transactions on Information and Systems,2006,E89-D(7):2164-2170.
[12]LU J,ZHAO J,CAO F.Extended feed forward neural networks with random weights for face recognition[J].Neurocomputing,2014,136(1):96-102.
[13]LECUN Y,BOTTOU L,BENGIO Y,et al.Gradient-based learning applied to document recognition[J].Proceedings of the IEEE,1998,86(11):2278-2324.
[14]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks[C]∥International Conference on Neural Information Processing Systems.Curran Associates Inc.2012:1097-1105.
[15]ZEILER M D,FERGUS R.Visualizing and Understanding Convolutional Networks[C]∥European Conference on Computer Vision.2013:818-833.
[16]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J/OL].[2015-04-10].https://arxiv.org/pdf/1409.1556v6.pdf.
[17]SZEGEDY C,LIU W,JIA Y,et al.Going deeper with convolutions[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2015:1-9.
[18]HE K,ZHANG X,REN S,et al.Deep Residual Learning for Ima-ge Recognition[C]∥Computer Vision and Pattern Recognition.IEEE,2016:770-778.
[19]HULL J J.A database for handwritten text recognition research[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1994,16(5):550-554.
[20]KRIZHEVSKY,ALEX.Learning Multiple Layers of Features from Tiny Images[M].Toronto:University of Toronto,2009.
[1] WU Hong-xin, HAN Meng, CHEN Zhi-qiang, ZHANG Xi-long, LI Mu-hang. Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning [J]. Computer Science, 2022, 49(8): 12-25.
[2] DU Li-jun, TANG Xi-lu, ZHOU Jiao, CHEN Yu-lan, CHENG Jian. Alzheimer's Disease Classification Method Based on Attention Mechanism and Multi-task Learning [J]. Computer Science, 2022, 49(6A): 60-65.
[3] YANG Jian-nan, ZHANG Fan. Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure [J]. Computer Science, 2022, 49(6A): 353-357.
[4] ZHU Xu-dong, XIONG Yun. Study on Multi-label Image Classification Based on Sample Distribution Loss [J]. Computer Science, 2022, 49(6): 210-216.
[5] PENG Yun-cong, QIN Xiao-lin, ZHANG Li-ge, GU Yong-xiang. Survey on Few-shot Learning Algorithms for Image Classification [J]. Computer Science, 2022, 49(5): 1-9.
[6] ZHANG Wen-xuan, WU Qin. Fine-grained Image Classification Based on Multi-branch Attention-augmentation [J]. Computer Science, 2022, 49(5): 105-112.
[7] XU Hua-jie, CHEN Yu, YANG Yang, QIN Yuan-zhuo. Semi-supervised Learning Method Based on Automated Mixed Sample Data Augmentation Techniques [J]. Computer Science, 2022, 49(3): 288-293.
[8] DONG Lin, HUANG Li-qing, YE Feng, HUANG Tian-qiang, WENG Bin, XU Chao. Survey on Generalization Methods of Face Forgery Detection [J]. Computer Science, 2022, 49(2): 12-30.
[9] CHEN Tian-rong, LING Jie. Differential Privacy Protection Machine Learning Method Based on Features Mapping [J]. Computer Science, 2021, 48(7): 33-39.
[10] HU Jing-hui, XU Peng. Automatic Classification of Aviation Fastener Products Based on Image Classification [J]. Computer Science, 2021, 48(6A): 63-66.
[11] WEI Dong, LIU Hao, CHEN Gen-long, GONG Xiao-hui. Underwater Image Enhancement Based on Color Correction and Deblurring [J]. Computer Science, 2021, 48(4): 144-150.
[12] XIE Hai-ping, LI Gao-yuan, YANG Hai-tao, ZHAO Hong-li. Classification Research of Remote Sensing Image Based on Super Resolution Reconstruction [J]. Computer Science, 2021, 48(11A): 424-428.
[13] WU Hao-hao and WANG Fang-shi. Application of Multi-scale Dilated Convolution in Image Classification [J]. Computer Science, 2020, 47(6A): 166-171.
[14] ZHANG Hua-li, KANG Xiao-dong, RAN Hua, WANG Ya-ge, LI Bo and BAI Fang. Comparative Study of DBN and CNN for Pulmonary Nodule Image Recognition [J]. Computer Science, 2020, 47(6A): 254-259.
[15] WANG Jun-qian, ZHENG Wen-xian, XU Yong. Novel Image Classification Based on Test Sample Error Reconstruction Collaborative Representation [J]. Computer Science, 2020, 47(6): 104-113.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!