计算机科学 ›› 2021, Vol. 48 ›› Issue (6A): 113-117.doi: 10.11896/jsjkx.201100119

• 图像处理&多媒体技术 • 上一篇    下一篇

基于多特征融合和卷积神经网络的植物叶片识别

韩斌1, 曾松伟1,2   

  1. 1 浙江农林大学信息工程学院 杭州311300
    2 浙江农林大学浙江省林业智能监测与信息技术研究重点实验室 杭州311300
  • 出版日期:2021-06-10 发布日期:2021-06-17
  • 通讯作者: 曾松伟(zsw@zafu.edu.cn)
  • 作者简介:hanbin@zafu.edu.cn
  • 基金资助:
    国家自然科学基金两化融合重点项目(U1809208);浙江省自然科学基金公益性项目(GN18C200030)

Plant Leaf Image Recognition Based on Multi-feature Integration and Convolutional Neural Network

HAN Bin1, ZENG Song-wei1,2   

  1. 1 School of Information Engineering,Zhejiang A&F University,Hangzhou 311300,China
    2 Zhejiang Key Laboratory of Forestry Intelligent Monitoring and Information Technology Research,Zhejiang A&F University,Hangzhou 311300,China
  • Online:2021-06-10 Published:2021-06-17
  • About author:HAN Bin,born in 1980,postgraduate.His main research interests include pattern recognition and intelligent information processing.
    ZENG Song-wei,born in 1975,Ph.D,associate professor.His main research interests include electronic information system integration and research on application of agriculture and forestry internet of things.
  • Supported by:
    Key Program of National Natural Science Foundation of China(U1809208) and Natural Science Public Welfare Foundation of Zhejiang Province,China(GN18C200030).

摘要: 植物叶片识别是植物自动分类识别研究的重要分支和热点,利用卷积神经网络进行图像分类研究已成为主流。为了提高植物叶片识别准确率,提出了基于多特征融合和卷积神经网络的植物叶片图像识别方法。首先对植物叶片图像进行预处理,提取LBP特征和Gabor特征,将多特征相加融合输入网络进行训练,使用卷积神经网络(AlexNet)构架作为分类器,利用全连接层对植物叶片进行识别。为了避免过拟合现象,使用“dropout”方法训练卷积神经网络,通过调节学习率、dropout值、迭代次数优化模型。实验结果表明,基于多特征融合的卷积神经网络植物叶片识别方法对Flavia数据库32种叶片和MEW2014数据库189种叶片识别分类效果较好,平均正确识别率分别为93.25%和96.37%,相比一般的卷积神经网络识别方法,该方法可以提高植物叶片的识别准确率,鲁棒性更强。

关键词: Gabor, LBP, 卷积神经网络, 深度学习, 植物叶片识别

Abstract: Plant leaf recognition is an important branch and hotspot of plant automatic classification and recognition.In order to improve the accuracy of plant leaf recognition,a method of multi-feature fusion combined with convolution neural network is proposed.In the experiment,Firstly,we extract LBP features and Gabor features.The leaf LBP coding map is evenly divided into 7×7 blocks,and different weights are assigned.The LBP histogram of each sub-block is calculated,and then normalized,and the normalized histogram of all sub-blocks is connected to obtain the whole Histogram and feature map.We use a four-direction Gabor filter to filtering the leaf image to obtain four sub-images.Each sub-image is divided into 4×4 sub-blocks,the average and variance of the filtered energy values of each sub-block are calculated,obtaining 128 dimensional Gabor features.Then the image of plant leaves is preprocessed to size 227×227 pixels with labels,local binary patterns features and Gabor features are extracted,the multi-features are added and fused through the feature fusion layer.Then the convolution neural network (AlexNet) framework is used as the classifier,and the full connection layer is used to identify the plant leaves.In order to avoid over fitting phenomenon,"dropout" method is used to train convolutional neural network,optimizing training model by adjusting learning rate and dropout value.The experimental results show that the plant recognition method based on multi-feature fusion convolution neural network classifies 32 kinds of leaves in Flavia leaves database and 189 kinds of leaves in MEW2014 leaves database,with an average correct recognition rate of 93.25% and 96.37%,respectively.This shows that compared with the general convolution neural network recognition method,this method can improve the recognition accuracy and robustness of plant leaves.

Key words: Convolutional neural network, Deep learning, Gabor, Leaf image recognition, Local binary patterns

中图分类号: 

  • TP391.41
[1] DONG H X,GUO S Y.Plant leaf classification method combining shape and texture features[J].Computer Engineering and Applications,2014,50(23):185-188.
[2] XIAO X Y.Study on features of plant leaf image recognition and realization of online recognition system[D].Hefei:University of Science and Technology of China,2011.
[3] WANG Z,CHI Z,FENG D,et al.Leaf image retrieval withshape features[J].Lecture Notes in Computer Science,2000,1929:477-487.
[4] NETO J C,MEYER G E,JONES D D,et al.Plant species identification using elliptic Fourier leaf shape analysis[J].Compu-ters & Electronics in Agriculture,2006,50(2):121-134.
[5] COPE J S,REMAGNINOP,BARMAN S,et al.Plant texture classification using gabor co-occurrences[M].Berlin Heidelberg:Springer,2010:669-677.
[6] CHAKI J,PAREKH R,BHATTACHARYA S.Plant leaf recognition using texture and shape features with neural classifiers[J].Pattern Recognition Letters,2015,58:61-68.
[7] WANG L J,HUAI Y J,PENG Y C.Method of identification of foliage from plants based on extraction of multiple features of leaf images[J].Journal of Beijing Forestry University,2015,37(1):96-104.
[8] DU J X,ZHAI C M,WANG Q P.Recognition of plant leafimage based on fractal dimension features[J].Neurocomputing,2013,116(10):150-156.
[9] WU S G,BAO F S,XU E Y,et al.A leaf recognition algorithm for plant classification using probabilistic neural network[C]//2007 IEEE international symposium on signal processing and information technology.Cairo:IEEE,2007:11-16.
[10] LIU N,KAN J M.Plant leaf identification based on the multi-feature fusion and deep belief networks method[J].Journal of Beijing Forestry University,2016,38(3):110-119.
[11] WANG X F,HUANG D S,DU J X,et al.Classification of plant leaf images with complicated background[J].Applied Mathematics and Computation,2008,205(2):916-926.
[12] NOVOTNY P,SUK T.Leaf recognition of woody species incentral Europe[J].Biosystems Engineering,2013,115(4):444-452.
[13] WIATOWSKI T,BOLCSKEI H.A mathematical theory of deep convolutional neural networks for feature extraction[J].IEEE Transactions on Information Theory,2018,64(3):1845-1866.
[14] KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks[C]//Proceedings of the 25th International Conference on Neural Information Processing Systems.Lake Tahoe:ACM,2012:1097-1105.
[15] LU H T,ZHANG Q C.Applications of deep convolutional neural network in computer vision[J].Journal of Data Acquisition and Processing,2016,31(1):1-17.
[16] LECUN Y,BOTTOU L,BENGIO Y,et al.Gradient-basedlearning applied to document recognition[J].Proceedings of the IEEE,1998,86(11):2278-2324.
[17] YE F M,DONG M,LUO W,et al.Agricultural remote sensing image retrieval based on convolutional neural network and reranking[J].Transactions of the Chinese Society of AgriculturalEngineering,2019,35(15):138-145.
[18] YUAN P,LI W,REN S G,et al.Recognition for flower type and variety of chrysanthemum with convolutional neural network[J].Transactions of the Chinese Society of Agricultural Engineering,2018,34(5):152-158.
[19] FU L S,FENG Y L,ELKAMIL T,et al.Image recognitionmethod of multi-cluster kiwifruit in field based on convolutional neural networks[J].Transactions of the Chinese Society of Agricultural Engineering,2018,34(2):205-211.
[20] LONG M S,OUYANG C J,LIU H,et al.Image recognition of Camellia oleiferadiseases based on convolutional neural network &transfer learning[J].Transactions of the Chinese Society of Agricultural Engineering,2018,34(18):194-201.
[21] SUN J,TAN W J,MAO H P,et al.Recognition of multiple plant leaf diseases based on improved convolutional neural network[J].Transactions of the Chinese Society of Agricultural Engineering,2017,33(19):209-215.
[22] JEON W,RHEE S.Plant leaf recognition using a convolution neural network[J].The International Journal of Fuzzy Logic and Intelligent Systems,2017,17(1):26-34.
[23] ZHANG S,HUAI Y J.Leaf image recognition based on layered convolutions neural network deep learning[J].Journal of Beijing Forestry University,2016,38(9):108-115.
[24] LEE S H,CHAN C S,WILKIN P,et al.Deep-plant:plant identification with convolutional neural networks[C]//Proceedings of 2015 IEEE International Conference on Image Processing (ICIP).Quebec:IEEE,2015:452-456.
[25] CHEN M S,CAI Z S.Study on fusion of visual and infrared images based on NSCT[J].Laser&Optoelectronics Progress,2015,52(6):061002.
[26] ZHANG L B,ZHANG J.A new adaptive fusion method based on saliency analysis for remote sensing images[J].Chinese Journal of Lasers,2015,42(1):0114011.
[27] YU H L,MA J W,ZHANG Y Z.Plant leaf recognition model based on two-way convolutional neural network[J].Journal of Beijing Forestry University,2018,40(12):132-137.
[28] SHI L,WANG Y M,CAO Y J,et al.Vehicle Type Recognition Based on Deep Convolution Neural Network[J].Computer Science,2018,45(5):280-284.
[29] ZHENG Y L,ZHONG G L,WANG Q,et al.Method of LeafIdentification Based on Multi-feature Dimension Reduction[J].Transactions of the Chinese Society for Agricultural Machinery,2017,48(3):30-37.
[1] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[2] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[3] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[4] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[5] 陈泳全, 姜瑛.
基于卷积神经网络的APP用户行为分析方法
Analysis Method of APP User Behavior Based on Convolutional Neural Network
计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121
[6] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[7] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[8] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[9] 李宗民, 张玉鹏, 刘玉杰, 李华.
基于可变形图卷积的点云表征学习
Deformable Graph Convolutional Networks Based Point Cloud Representation Learning
计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[10] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[11] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[12] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[13] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[14] 张颖涛, 张杰, 张睿, 张文强.
全局信息引导的真实图像风格迁移
Photorealistic Style Transfer Guided by Global Information
计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[15] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!