Computer Science ›› 2021, Vol. 48 ›› Issue (11A): 360-366.doi: 10.11896/jsjkx.201000166

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Multi-scale U Network Realizes Segmentation and Recognition of Tomato Leaf Disease

GU Xing-jian, ZHU Jian-feng, REN Shou-gang, XIONG Ying-jun, XU Huan-liang   

  1. School of Artificial Intelligence,Nanjing Agricultural University,Nanjing 210095,China
  • Online:2021-11-10 Published:2021-11-12
  • About author:GU Xing-jian,born in 1985,Ph.D,lecturer,is a member of China Computer Federation.His main research interests include machine learning and pattern recognition.
    REN Shou-gang,born in 1977,Ph.D,associate professor,is a member of China Computer Federation.His main research interests include big data analysis and agricultural information.
  • Supported by:
    National Natural Science Foundation of China(61806097).

Abstract: With the development of deep learning technology,convolutional neural network has been the mainstream method for plant leaf disease recognition and disease spot segmentation.Aiming at the problems of different sizes and irregular shapes of tomato leaf lesions,need for a large number of pixel-level labels,a novel multi-scale U network is proposed,which realizes tomato leaf lesion segmentation and disease recognition simultaneously.For disease feature extraction,a multi-scale residual module including different sizes of receptive fields is used to extract disease features according to the different disease spot size and shape.The CB module (Classifier and Bridge) is introduced to connect the disease feature extraction stage with the lesion segmentation stage,which classifies the disease and also reversely generates an activation map of specific class according to the classification result.This activation map contains the specific type of lesions label information.In the segmentation stage,upsampling and convolution are used to deconvolve the activation map.The deconvolution feature and the low-level feature are merged by the jump connection method.In order to make lesion location segmentation more accurate,a few of pixel-level labels are used for training to minimize two-class cross-entropy loss.In the experiment,the original samples and samples with simulated noise and light intensity are used to verify the performance of disease spot segmentation and disease recognition of our method.On the original sample set,the average pixel accuracy,average intersection ratio,and frequency weight intersection ratio of our method reaches 86.15%,75.25%,and 90.27%,respectively.In the interference sample with 30% brightness reduction,salt and pepper noise,the recognition accuracy of our method obtains 95.10% and 99.20% respectively.Experimental results show that the proposed method can achieve improvement in segmentation and recognition of tomato leaf lesions simultaneously.

Key words: Convolutional neural network, Image recognition, Image segmentation, Leaf diseases, Multiscale

CLC Number: 

  • TP391
[1]WANG X Y,WEN H J,LI X X,et al.Analysis of research progress in detection and early warning technologies for major agricultural diseases[J].Journal of Agricultural Machinery,2016,47(9):266-277.
[2]PUJARI J D,YAKKUNDIMAT H.SVM and ANN Based Classification of Plant Diseases Using Feature Reduction Technique[J].INT J Interract Multi,2016,3(7):6-14.
[3]WANG D,CHAI X J.Application of machine learning in plant diseases recognition[J].Journal of Chinese Agricultural Mechanization,2019,40(9):171-180.
[4]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks[J].Advances in Neural Information Processing Systems,2012,2:1097-1105.
[5]MOHANTY S P,HUGHES D P,MARCEL S.Using deeplearning for image-based plant disease detection[J].Frontiers in Plant Science,2016,7:1-10.
[6]SRDJAN S,MARKO A,ANDRAS A,et al.Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification[J].Computational Intelligence and Neuroscience,2016,2016:1-11.
[7]AMARA J,BOUAZIZ B,ALGERGAWY A.A deep learning-based approach for banana leaf diseases classification[J].Lecture Notes in Informatics (LNI),Proceedings- Series of the Gesellschaft fur Informatik (GI),2017,266:79-88.
[8]BRAHIMI M,BOUKHALFA K,MOUSSAOUI A.Deep Learning for Tomato Diseases:Classification and Symptoms Visualization[J].Applied Artificial Intelligence,2017,31 (4/5/6):1-17.
[9]FERENTINOS K.Deep learning models for plant disease detection and diagnosis[J].Computers and Electronics in Agriculture,2018(145):311-318.
[10]LIANG Q,XIANG S,HU Y,et al.PD2SE-Net:Computer-assisted plant disease diagnosis and severity estimation network[J].Computers and Electronics in Agriculture,2019,157:518-529.
[11]SUN J,TAN W J,MAO H P,et al.Recognition of multiple plant leaf diseases based on improved convolutional neural network[J].Transactions of the Chinese Society of Agricultural Engineering,2017,33(19):209-215.
[12]GUO X Q,FAN T J,SHU X.Image recognition of tomato leaf diseases based on improved Multi-Scale AlexNet[J].Transactions of the Chinese Society of Agricultural Engineering,2019,35(13):162-169.
[13]XIAO Z Y,ZHAO X C.Recognition of typical pasture based on dual pooling and multi-scale kernel feature weighted CNN[J].Journal of Agricultural Machinery,2020,51(5):182-191.
[14]YU H J,SON C H.Apple Leaf Disease Identification throughRegion-of-Interest-Aware Deep Convolutional Neural Network[J].Journal of Imaging ence and Technology,2020,64(2):20507-1-20507-10.
[15]YANG W,BI X L,XIAO B.Agricultural pests detection method based on regional convolutional neural network[J].Computer Science,2018,45(S2):226-229,233.
[16]BRAHIMI M,MAHMOUDI S,BOUKHALFA K,et al.Deepinterpretable architecture for plant diseases classification[C]//Signal Processing:Algorithms,Architectures,Arrangements,and Applications (SPA).New Mexico,USA,2019:111-116.
[17]LONG J,SHELHAMER E,DARRELL T.Fully Convolutional Networks for Semantic Segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,39(4):640-651.[18]RONNEBERGER O,FISCHER P,BROX T.U-net:convolu-tional networks for biomedical image segmentation[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.2015:234-241.
[19]OKTAY O,SCHLEMPER J,FOLGOC L L,et al.Attentionu-net:Learning where to look for the pancreas[J].arXiv,2018.
[20]ZHOU Z,SIDDIQUEE M M R,TAJBAKHSH N,et al.Net++:A Nested U-Net Architecture for Medical Image Segmentation[J].Lecture Notes in Computer Science,2018,11045 LNCS:3-11.
[21]ZHAO B,FENG Q.Segmentation of grape diseases leaf basedon full convolution network[J].Journal of Nanjing Agricultural University,2018,41(4):752-759.
[22]WANG Z,ZHANG S W,WANG X F.Cucumber leaf lesion segmentation method based on improved fully convolutional neural network[J].Jiangsu Journal of Agriculture,2019,35(5):1054-1060.
[23]RUSSELL B C,TORRALBA A,MURPHY K P,et al.La-belMe:a database and web-based tool for image annotation[J].International Journal of Computer Vision,2008,77(1/2/3):157-173.
[24]HE K,ZHANG X,REN S,et al.Deep residual learning for image recognition[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2016:770-778.
[25]HE K,ZHANG X,REN S,et al.Delving deep into rectifiers:Surpassing human-level performance on imagenet classification[C]//Proceedings of the IEEE International Conference on Computer Vision,2015,2015 International Conference on Computer Vision.2015:1026-1034.
[26]KINGMA D P,BA J.Adam:A method for stochastic optimization[J].arXiv,2014.
[27]GAO S,CHENG M M,ZHAO K,et al.Res2net:A new multi-scale backbone architecture[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021,43(2):652-662.
[28]HU J,LI S,GANG S,et al.Squeeze-and-Excitation Networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,42(8):2011-2023.
[1] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[2] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[3] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[4] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[5] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
[6] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[7] YANG Yue, FENG Tao, LIANG Hong, YANG Yang. Image Arbitrary Style Transfer via Criss-cross Attention [J]. Computer Science, 2022, 49(6A): 345-352.
[8] YANG Jian-nan, ZHANG Fan. Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure [J]. Computer Science, 2022, 49(6A): 353-357.
[9] ZHANG Jia-hao, LIU Feng, QI Jia-yin. Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer [J]. Computer Science, 2022, 49(6A): 370-377.
[10] WANG Jian-ming, CHEN Xiang-yu, YANG Zi-zhong, SHI Chen-yang, ZHANG Yu-hang, QIAN Zheng-kun. Influence of Different Data Augmentation Methods on Model Recognition Accuracy [J]. Computer Science, 2022, 49(6A): 418-423.
[11] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[12] WU Zi-bin, YAN Qiao. Projected Gradient Descent Algorithm with Momentum [J]. Computer Science, 2022, 49(6A): 178-183.
[13] ZHAO Zheng-peng, LI Jun-gang, PU Yuan-yuan. Low-light Image Enhancement Based on Retinex Theory by Convolutional Neural Network [J]. Computer Science, 2022, 49(6): 199-209.
[14] ZHAO Xiao-hu, YE Sheng, LI Xiao. Multi-algorithm Fusion Behavior Classification Method for Body Bone Information Reconstruction [J]. Computer Science, 2022, 49(6): 269-275.
[15] HU Fu-yuan, WAN Xin-jun, SHEN Ming-fei, XU Jiang-lang, YAO Rui, TAO Zhong-ben. Survey Progress on Image Instance Segmentation Methods of Deep Convolutional Neural Network [J]. Computer Science, 2022, 49(5): 10-24.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!