计算机科学 ›› 2021, Vol. 48 ›› Issue (4): 151-156.doi: 10.11896/jsjkx.200500049

所属专题: 医学图像

• 计算机图形学&多媒体 • 上一篇    下一篇

基于BCNN的胎儿颅脑超声横切面识别算法

束鑫1, 常锋1, 张歆2, 杜睿2, 余转2   

  1. 1 江苏科技大学计算机学院 江苏 镇江212003
    2 江苏大学附属医院超声医学科 江苏 镇江212003
  • 收稿日期:2020-06-24 修回日期:2020-09-18 出版日期:2021-04-15 发布日期:2021-04-09
  • 通讯作者: 束鑫(shuxin@just.edu.cn)
  • 基金资助:
    国家自然科学基金(61876072);江苏省妇幼健康科研面上项目(F201822);镇江市重点研发计划(社会发展)项目(SH2019038)

Transverse Section Recognition Algorithm Based on BCNN for Fetal Craniocerebral Ultrasound

SHU Xin1, CHANG Feng1, ZHANG Xin2, DU Rui2, YU Zhuan2   

  1. 1 School of Computer Science,Jiangsu University of Science and Technology,Zhenjiang,Jiangsu 212003,China
    2 Department of Medical Ultrasound,Affiliated Hospital of Jiangsu University,Zhenjiang,Jiangsu 212003,China
  • Received:2020-06-24 Revised:2020-09-18 Online:2021-04-15 Published:2021-04-09
  • About author:SHU Xin,born in 1979.Ph.D,associate professor,is a member of China Computer Federation.His main research interests include medical image analysis,face recognition and pattern recognition.
  • Supported by:
    National Natural Science Foundation of China(61876072),Maternal and Child Health Research Project of Jiangsu Province(F201822) and Key Research and Development Project of Zhenjiang(Social Development)(SH2019038).

摘要: 孕期超声检查是评估胎儿大脑发育、检测生长异常的重要步骤,开展对胎儿早期检查准确高效的诊断研究具有重要的临床价值。文中使用双线性卷积神经网络BCNN进行胎儿颅脑横切面识别,提出了BCNN-R和BCNN-S两种算法。BCNN算法首先对输入的胎儿颅脑超声影像数据进行预处理,去除个人信息等敏感信息;其次,利用两路并行的子网络从影像数据中提取辨识度高、鲁棒性强的横切面特征,并将其融合得到有助于识别的细微特征;最后使用线性连接层进行识别和分类。为了验证算法的有效性,在自建胎儿超声数据集JFU19上进行了对比实验,实验结果表明,所提算法相比常见的深度网络(GoogleNet,DenseNet,SeNet等)在分类性能上有明显的提升,其中BCNN-S算法的总体准确率达到了88.95%,BCNN-R在水平横切面的识别上达到了97.22%的精确度和88.61%的召回率。此外,在公开数据集HC18上进行了实验,BCNN算法的准确率、精确度、召回率分别达到了89.48%,87.66%和87.71%,进一步验证了算法的有效性。

关键词: BCNN, 横切面识别, 颅脑图像, 深度学习, 胎儿超声

Abstract: Ultrasound examination during pregnancy is an important step to discover whether the fetus is abnormal,so it is of great value to carry out accurate and efficient examination and diagnosis on fetus.In this paper,bilinear convolutional neural network(BCNN) is used to identify the transverse section of the fetal head.On this basis,we propose BCNN-R and BCNN-S.The BCNN model takes the fetal craniocerebral ultrasound image as input,and firstly preprocesses the input data.Secondly,the two parallel sub-networks can extract the cross-sectional features with high identification and strong robustness from the input,after that the model integrates the extracted features,which is helpful to extract the fine features for recognition.Finally,the linear layer outputs the result of classification.In order to verify the effectiveness of the proposed algorithm,this paper makes contrast experiment on self-built fetal ultrasound dataset JTU19.The experimental results show that the proposed algorithms have ob-vious improvement on classification performance compared with the basic network(GoogleNet,DenseNet,SeNet,etc.),the overall accuracy of BCNN-S reaches 88.95%,and the precision and recall of BCNN-R in horizontal cross-sections achieves 97.22% and 88.61%.In addition,we also use the public dataset HC18 to conduct classification experiments.The accuracy,precision and recall of BCNN reach 89.48%,87.66% and 87.71% respectively,which further verifies the effectiveness of the proposed algorithms.

Key words: BCNN, Craniocerebrum image, Deep learning, Fetal ultrasound, Identification of transverse section

中图分类号: 

  • TP391
[1]VAN DEN HEUVEL T L A,PETROS H,SANTINI S,et al.Automated fetal head detection and circumference estimation from free-hand ultrasound sweeps using deep learning in resource-limited countries[J].Ultrasound in Medicine & Biology,2019,45(3):773-785.
[2]YAQUB M,KELLY B,PAPAGEORGHIOU A T,et al.A deep learning solution for automatic fetal neurosonographic diagnostic plane verification using clinical standard constraints[J].Ultrasound in Medicine & Biology,2017,43(12):2925-2933.
[3]MURTY M N,DEVI V S.Introduction to pattern recognitionand machine learning[M].Co-Published with Indian Institute of Science(IISc),Bangalore,India,2015.
[4]SHAN J,ALAM S K,GARRA B,et al.Computer-aided diagnosis for breast ultrasound using computerized BI-RADS features and machine learning methods[J].Ultrasound in Medicine & Bio-logy,2016,42(4):980-988.
[5]LEI B,ZHUO L,CHEN S,et al.Automatic recognition of fetal standard plane in ultrasound image[C]//2014 IEEE 11th International Symposium on Biomedical Imaging(ISBI).IEEE,2014:85-88.
[6]OJALA T,PIETIKAINEN M,MAENPAA T.Multiresolution gray-scale and rotation invariant texture classification with local binary patterns[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2002,24(7):971-987.
[7]SONG L,LIU X,MA L,et al.Using HOG-LBP features and MMP learning to recognize imaging signs of lung lesions[C]//2012 25th IEEE International Symposium on Computer-Based Medical Systems(CBMS).IEEE,2012:1-4.
[8]LEI B,TAN E L,CHEN S,et al.Automatic recognition of fetal facial standard plane in ultrasound image via fisher vector[J].PloS one,2015,10(5):e0121838.
[9]LEI B,YAO Y,CHEN S,et al.Discriminative learning for automatic staging of placental maturity via multi-layer fisher vector[J].Scientific Reports,2015,5(1):1-11.
[10]MA Y,WU L,LI Z.A novel face presentation attack detection scheme based on multi-regional convolutional neural networks[J].Pattern Recognition Letters,2020,131:261-267.
[11]CHEN H,NI D,QIN J,et al.Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks[J].IEEE Journal of Biomedical and Health Informatics,2015,19(5):1627-1636.
[12]YU Z,WU L Y,NI D,et al.Automatic Recognition of Fetal Facial Ultrasound Standard Section based on Deep Learning[J].Chinese Journal of Biomedical Engineering,2017(3):267-275.
[13]LIN T Y,ROYCHOWDHURY A,MAJI S.Bilinear cnn models for fine-grained visual recognition[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:1449-1457.
[14]YOSINSKI J,CLUNE J,BENGIO Y,et al.How transferableare features in deep neural networks?[C]//Advances in Neural Information Processing Systems.2014:3320-3328.
[15]MALLAT S.Understanding deep convolutional networks[J].Philosophical Transactions of the Royal Society A:Mathematical,Physical and Engineering Sciences,2016,374(2065):20150203.
[16]HE K,ZHANG X,REN S,et al.Delving deep into rectifiers:Surpassing human-level performance on imagenet classification[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:1026-1034.
[17]VAN DEN HEUVEL T L A,PETROS H,SANTINI S,et al.Automated fetal head detection and circumference estimation from free-hand ultrasound sweeps using deep learning in resource-limited countries[J].Ultrasound in Medicine & Biology,2019,45(3):773-785.
[18]HE K,ZHANG X,REN S,et al.Deep residual learning for ima-ge recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778.
[19]MAAS A L,HANNUN A Y,NG A Y.Rectifier nonlinearities improve neural network acoustic models[C]//Proc.ICML.2013.
[20]IANDOLA F N,HAN S,MOSKEWICZ M W,et al.Squeeze-Net:AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size[J].arXiv:1602.07360,2016.
[21]SZEGEDY C,LIU W,JIA Y,et al.Going deeper with convolutions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:1-9.
[22]VAN D H T L A,DAGMAR D B,et al.Automated measurement of fetal head circumference using 2D ultrasound images[J].PloS One,13.8(2018):e0200412.
[23]VAN D H T L A,DAGMAR D B,et al.Automated measurement of fetal head circumference using 2D ultrasound images [DB/OL].Zenodo.http://doi.org/10.5281/zenodo.1322001.
[24]SZEGEDY C,LIU W,JIA Y,et al.Going deeper with convolutions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:1-9.
[25]HU J,SHEN L,SUN G.Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:7132-7141.
[26]HUANG G,LIU Z,VAN DER MAATEN L,et al.Densely connected convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:4700-4708.
[27]KINGMA D P,BA J.Adam:A method for stochastic optimization[J].arXiv:1412.6980,2014.
[28]HE K,GIRSHICK R,DOLLÁR P.Rethinking imagenet pre-training[C]//Proceedings of the IEEE International Conference on Computer Vision.2019:4918-4927.
[1] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[2] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[3] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[4] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[5] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[6] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[7] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[8] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[9] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[10] 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木.
中文预训练模型研究进展
Advances in Chinese Pre-training Models
计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[11] 周慧, 施皓晨, 屠要峰, 黄圣君.
基于主动采样的深度鲁棒神经网络学习
Robust Deep Neural Network Learning Based on Active Sampling
计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[12] 苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫.
小样本雷达辐射源识别的深度学习方法综述
Survey of Deep Learning for Radar Emitter Identification Based on Small Sample
计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[13] 祝文韬, 兰先超, 罗唤霖, 岳彬, 汪洋.
改进Faster R-CNN的光学遥感飞机目标检测
Remote Sensing Aircraft Target Detection Based on Improved Faster R-CNN
计算机科学, 2022, 49(6A): 378-383. https://doi.org/10.11896/jsjkx.210300121
[14] 王建明, 陈响育, 杨自忠, 史晨阳, 张宇航, 钱正坤.
不同数据增强方法对模型识别精度的影响
Influence of Different Data Augmentation Methods on Model Recognition Accuracy
计算机科学, 2022, 49(6A): 418-423. https://doi.org/10.11896/jsjkx.210700210
[15] 毛典辉, 黄晖煜, 赵爽.
符合监管合规性的自动合成新闻检测方法研究
Study on Automatic Synthetic News Detection Method Complying with Regulatory Compliance
计算机科学, 2022, 49(6A): 523-530. https://doi.org/10.11896/jsjkx.210300083
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!