计算机科学 ›› 2022, Vol. 49 ›› Issue (4): 247-253.doi: 10.11896/jsjkx.210200093

• 计算机图形学&多媒体 • 上一篇    下一篇

基于CNN的血液细胞图像自动识别算法

李国权1,2, 姚凯1,2, 庞宇2   

  1. 1 重庆邮电大学通信与信息工程学院 重庆 400065;
    2 光电信息感测与传输技术重庆市重点实验室 重庆 400065
  • 收稿日期:2021-02-09 修回日期:2021-05-26 发布日期:2022-04-01
  • 通讯作者: 李国权(ligq@cqupt.edu.cn)
  • 基金资助:
    国家重点研发计划基金(2019YFC1511300); 重庆市自然科学基金(cstc2019jcyj-msxmX0666,cstc2019jcyj-xfkxX0002)

Automatic Identification Algorithm of Blood Cell Image Based on Convolutional Neural Network

LI Guo-quan1,2, YAO Kai1,2, PANG Yu2   

  1. 1 School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China;
    2 Chongqing Key Laboratory of Photoelectronic Information Sensing and Transmitting Technology, Chongqing 400065, China
  • Received:2021-02-09 Revised:2021-05-26 Published:2022-04-01
  • About author:LI Guo-quan,born in 1980,Ph.D,professor,master supervisor.His main research interests include wireless communication transmission technology,heterogeneous wireless network transmission technology and medical signal processing and so on.
  • Supported by:
    This work was supported by the National Key Research and Development Program of China(2019YFC1511300) and Natural Science Foundation of Chongqing(cstc2019jcyj-msxmX0666,cstc2019jcyj-xfkxX0002).

摘要: 全血细胞计数是医学诊断中评价健康状况的重要检测手段。为解决传统血细胞计数器及其他设备对血细胞人工计数程序繁琐且耗时较长的问题,提出了一种基于卷积神经网络的血液细胞识别算法,即基于Res2Net和YOLO对象检测算法对3种类型的血液细胞进行自动识别和计数。通过将Res2Net融入YOLO模型来提取更细粒度表示的多尺度特征和增加每个网络层的感受野范围,以提升血液细胞识别模型的性能。在公开血液涂片图像数据集的训练和测试结果表明,所提方法能够自动识别和计数红细胞、白细胞和血小板,识别准确率分别达到了96.09%,93.44%,96.36%。与其他基于卷积神经网络的识别模型相比,所提方法识别准确率高且具有较强的泛化性,能显著提升血液检测的效率。

关键词: Res2Net, YOLO算法, 卷积神经网络, 血液细胞识别

Abstract: A complete blood cell count is an important testing technique to evaluate overall health condition in medical diagnosis.In order to solve the problem that traditional blood cell counters and other devices are cumbersome and time-consuming for the artificial counting procedure of blood cells, a blood cell recognition algorithm based on convolutional neural networks is proposed, that is, three types of blood cells are automatically identified and counted based on Res2Net and YOLO object detection algorithm.The performance of the blood cell identification model is enhanced by incorporating Res2Net into the YOLO model to extract multiscale features represented by fine-grained and increase the range of receptive field in each network layer.After training and testing on an public blood smear image dataset, it can automatically identify and count red blood cells, white blood cells, and platelets, and the accuracy of identification reaches 93.44%, 96.09%, and 96.36%, respectively.Compared with other recognition models based on convolutional neural networks, the efficiency of blood detection can be significantly improved due to the high re-cognition accuracy and strong generalization.

Key words: Blood cell identification, Convolutional neural network, Res2Net, YOLO algorithm

中图分类号: 

  • TP391
[1] CRUZ D,JENNIFER C,VALIENTE L C,et al.Determination of blood components (WBCs,RBCs,and Platelets) count in microscopic images using image processing and analysis[C]//2017 IEEE 9th International Conference on Humanoid,Nanotechno-logy,Information Technology,Communication and Control,Environment and Management (HNICEM).Manila:IEEE Press,2017:1-7.
[2] HABIBZADEH M,KRZYAIJAK A.White blood cell differen-tial counts using convolutional neural networks for low resolution images[J].Proc. Int. Conf. on Artificial Intelligence and Soft Computing,2013,7895(8):263-274.
[3] ACHARJEE S,CHAKRABARTTY S M I,ALAM M I,et al.A semiautomated approach using GUI for the detection of red blood cells[C]//2016 International Conference on Electrical,Electronics and Optimization Techniques (ICEEOT).Chennai:IEEE Press,2016:525-529.
[4] SYED H S,ARIF I U,NUHMANUI H,et al.Extreme learning machine based microscopic red blood cells classification[J].Cluster Computing,2018,21(1):691-701.
[5] ACHARYA V,KUMAR P.Identification and red blood cell automated counting from blood smear images using computer-aided system[J].Medical & Biological Engineering & Computing,2018,56(3):483-489.
[6] SARRAFZADEH O,DEHNAVI A M,RABBANI H,et al.Circlet based framework for red blood cells segmentation and counting[C]//2015 IEEE Workshop on Signal Processing Systems (SiPS).Hangzhou,China:IEEE Press,2015:1-6.
[7] KAUR P,SHARMA V,GARG N.Platelet count using imageprocessing[C]//2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).New Delhi,India:IEEE Press,2016:2574-2577.
[8] ISLAM M T,AOWAL M A,MINHAZ A T,et al.Abnormality detection and localization in chest X-rays using deep convolutional neural networks[EB/OL].(2017-9-27) [2020-11-30].https://arxiv.org/abs/1705.09850v3.
[9] AVENDI M R,KHERADVAR A,JAFARKHANI H.A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI[J].Medical Image Analysis,2016,30(6):108-119.
[10] GULSHAN V,PENG L,CORAM M,et al.Development andvalidation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs[J].J Am Med Assoc,2016,316(22):2402-2410.
[11] ZHAO J W,ZHANG M S,ZHOU Z H,et al.Automatic detection and classificationof leukocytes using convolutional neural networks[J].Medical & Biological Engineering & Computing,2017,55(8):1287-1301.
[12] HE K M,ZHANG X Y,REN S Q,et al.Deep Residual Learning for Image Recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Las Vegas,NV,USA:IEEE Press,2016:770-778.
[13] SZEGEDY C,VANHOUCKE V,IOFFE S,et al.Rethinking the Inception Architecture for Computer Vision[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Las Vegas,NV,USA:IEEE Press,2016:2818-2826.
[14] HABIBZADEH M,JANNESARI M,REZAEI Z,et al.Auto-matic white blood cell classification using pre-trained deep lear-ning models:ResNet and inception[C]//Tenth International Conference on Machine Vision (ICMV).Vienna,Austria:SPIE,2017:1-8.
[15] XU M,PAPAGEORGIOU D P,ABIDI S Z,et al.A deep convolutional neural network for classification of red blood cells in sickle cell anemia[J].PLoS Comput Biol,2017,13(10):1-27.
[16] MACAWILE M J,QUINONES V V,BALLADO A,et al.Whiteblood cell classification and counting using convolutional neural network[C]//2018 3rd International Conference on Control and Robotics Engineering (ICCRE).Nagoya,Japan:IEEE Press,2018:259-263.
[17] ACEVEDO A,ALFEREZ S,MERINO A,et al.Recognition of peripheral blood cell images using convolutional neural networks[J].Computer Methods and Programs in Biomedicine,2019,180(6):105020-105036.
[18] WANG Q,BI S,SUN M,et al.Deep learning approach to peripheral leukocyte recognition[J].PLOS ONE,2019,14(6):218-236.
[19] TOGACAR M,ERGEN B,COMERT Z.Classification of white blood cells using deep features obtained from Convolutional Neural Network models based on the combination of feature selection methods[J].Applied Soft Computing,2020,97(2):1568-1592.
[20] MALKAWI A,SALAMEH T,SHEYAB B,et al.White Blood Cells Classification Using Convolutional Neural Network Hybrid System[C]//2020 IEEE 5th Middle East and Africa Conference on Biomedical Engineering (MECBME).Amman,Jordan:IEEE Press,2020:1-5.
[21] SAHLOL A T,KOLLMANNSBERGER P,EWEES A.Efficient Classification of White Blood Cell Leukemia with Improved Swarm Optimization of Deep Features[J].Scientific Reports,2020,10(1):2536-2547.
[22] LONG F,PENG J J,SONG W T,et al.BloodCaps:A capsulenetwork based model for the multiclassification of human peripheral blood cells[J].Computer Methods and Programs in Biomedicine,2021,202(8):105972-105972.
[23] JIANG Z C,ZHAO L Q,LI S Y,et al.Real-time object detection method based on improved YOLOv4-tiny[EB/OL].(2020-11-09) [2020-11-30].https://arxiv.org/abs/2011.04244v1.
[24] GAO S H,CHENG M M,ZHAO K,et al.Res2Net:A New Multi-scale Backbone Architecture[EB/OL].(2019-09-01) [2020-11-30].https://arxiv.org/abs/1904.01169v2.
[25] BOCHKOVSKIY A.,WANG C Y,LIAO H Y.YOLOv4:Optimal Speed and Accuracy of Object Detection[EB/OL].(2020-04-23) [2020-11-30].https://arxiv.org/abs/2004.10934v1.
[26] REDMON J,FARHADI F.YOLO9000:Better,Faster,Stronger[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Honolulu,HI,USA:IEEE Press,2017:6517-6525.
[27] ZHENG Z H,PANG W,LIU W,et al.Distance-IoU Loss:Faster and Better Learning for Bounding Box Regression[EB/OL].(2019-11-19) [2020-11-30].https://arxiv.org/abs/1911.08287v1.
[28] SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[C]//2015 International Conference on Learning Representations.San Diego,2015:1-14.
[29] HOWARD A G,ZHU M,KALENICHENKO B,et al.Mobilenets:efficient convolutional neural networksfor mobile vision applications[EB/OL].(2017-4-17) [2020-11-30].https://arxiv.org/abs/1704.04861.
[1] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[2] 李宗民, 张玉鹏, 刘玉杰, 李华.
基于可变形图卷积的点云表征学习
Deformable Graph Convolutional Networks Based Point Cloud Representation Learning
计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[3] 陈泳全, 姜瑛.
基于卷积神经网络的APP用户行为分析方法
Analysis Method of APP User Behavior Based on Convolutional Neural Network
计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121
[4] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[5] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[6] 金方焱, 王秀利.
融合RACNN和BiLSTM的金融领域事件隐式因果关系抽取
Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM
计算机科学, 2022, 49(7): 179-186. https://doi.org/10.11896/jsjkx.210500190
[7] 张颖涛, 张杰, 张睿, 张文强.
全局信息引导的真实图像风格迁移
Photorealistic Style Transfer Guided by Global Information
计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[8] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
[9] 刘月红, 牛少华, 神显豪.
基于卷积神经网络的虚拟现实视频帧内预测编码
Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network
计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[10] 徐鸣珂, 张帆.
Head Fusion:一种提高语音情绪识别的准确性和鲁棒性的方法
Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition
计算机科学, 2022, 49(7): 132-141. https://doi.org/10.11896/jsjkx.210100085
[11] 孙福权, 崔志清, 邹彭, 张琨.
基于多尺度特征的脑肿瘤分割算法
Brain Tumor Segmentation Algorithm Based on Multi-scale Features
计算机科学, 2022, 49(6A): 12-16. https://doi.org/10.11896/jsjkx.210700217
[12] 吴子斌, 闫巧.
基于动量的映射式梯度下降算法
Projected Gradient Descent Algorithm with Momentum
计算机科学, 2022, 49(6A): 178-183. https://doi.org/10.11896/jsjkx.210500039
[13] 杨涵, 万游, 蔡洁萱, 方铭宇, 吴卓超, 金扬, 钱伟行.
基于步态分类辅助的虚拟IMU的行人导航方法
Pedestrian Navigation Method Based on Virtual Inertial Measurement Unit Assisted by GaitClassification
计算机科学, 2022, 49(6A): 759-763. https://doi.org/10.11896/jsjkx.211200148
[14] 张嘉淏, 刘峰, 齐佳音.
一种基于Bottleneck Transformer的轻量级微表情识别架构
Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer
计算机科学, 2022, 49(6A): 370-377. https://doi.org/10.11896/jsjkx.210500023
[15] 王建明, 陈响育, 杨自忠, 史晨阳, 张宇航, 钱正坤.
不同数据增强方法对模型识别精度的影响
Influence of Different Data Augmentation Methods on Model Recognition Accuracy
计算机科学, 2022, 49(6A): 418-423. https://doi.org/10.11896/jsjkx.210700210
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!