计算机科学 ›› 2019, Vol. 46 ›› Issue (3): 242-247.doi: 10.11896/j.issn.1002-137X.2019.03.036

• 人工智能 • 上一篇    下一篇

端到端单通道睡眠EEG自动分期模型

金欢欢1,尹海波2,何玲娜1   

  1. (浙江工业大学计算机科学与技术学院 杭州 310023)1
    (哈尔滨工业大学航天学院 哈尔滨 150001)2
  • 收稿日期:2018-01-18 修回日期:2018-04-10 出版日期:2019-03-15 发布日期:2019-03-22
  • 通讯作者: 何玲娜(1978-),女,副教授,主要研究方向为脑机接口,E-mail:2099376617@qq.com
  • 作者简介:金欢欢(1990-),女,硕士生,主要研究方向为机器学习、脑机接口;尹海波(1990-),男,硕士生,主要研究方向为神经网络、智能诊断
  • 基金资助:
    浙江科技计划公益技术项目(2015C31111)资助

End-to-End Single-channel Automatic Staging Model for Sleep EEG Signal

JIN Huan-huan1,YIN Hai-bo2,HE Ling-na1   

  1. (College of Computer Science and Technology,Zhejiang University of Technology,Hangzhou 310023,China)1
    (School of Astronautics,Harbin Institute of Technology,Harbin 150001,China)2
  • Received:2018-01-18 Revised:2018-04-10 Online:2019-03-15 Published:2019-03-22

摘要: 针对现阶段数据和特征决定自动睡眠分期模型的分类精度上限的问题,提出一种基于深度混合神经网络的自动睡眠分期模型。在模型主体构建方面,使用多尺度卷积神经网络自动学习高级时不变特征,使用双向门限循环单元构建的循环神经网络对时不变特征中的时间信息进行解码,并用残差连接实现时不变特征与时间信息特征的融合。在模型优化方面,将MSMOTE(Modified Synthetic Minority Oversampling Technique)重构后的数据集用于预训练,以减少类不平衡对少数类的分类效果的影响,应用Swish激活函数加速模型收敛。使用Sleep-EDF数据集中Fpz-Cz通道的原始EEG数据对模型进行15折交叉验证,得出OA(Overall Accuracy)和MF1(Macro-averaged F1-score)分别为86.85%和81.63%。提出的模型可避免特征选取的主观性以及类不平衡小数据集在深度学习中的局限性。

关键词: Swish, 单通道, 端到端, 门限循环单元, 深度学习, 睡眠分期

Abstract: The classification accuracy of current automatic sleep staging is determined by the small data set of imba-lanced classes and hand-engineered features.Aiming at this problem,this paper proposed an automatic sleep staging model based on deep hybrid neural network.For the construction of model’s main structure,the multi-scale Convolutional Neural Networks are used to automatically learn the high-level time-invariant features,the Recurrent Neural Networks constructed by bidirectional Gated Recurrent Unit are used to decode the temporal information from the time invariant features,and the residual connection is used to fully combine the time invariant features with the time information features.For model optimization,in order to reduce the impact of the dataset of imbalanced class on the classification effect of minority class,the experimental data set reconstructed by MSMOTE (Modified Synthetic Minority Oversampling Technique) is used for pre-training.The Swish activation function is used to accelerate the training convergence rate.The experiment was set up on the initial single-channel EEG signal of Fpz-Cz in Sleep-EDF Database.The 15-fold cross-validation experiments show that the overall classification accuracy is 86.85% and the Macro-averaged F1-score is 81.63%.This model can effectively avoid the subjectivity of feature selection and the limitation of class imba-lanced small dataset of imbalanced class in deep learning.

Key words: Deep learning, End to end, Gated recurrent unit, Single-channel, Sleep staging, Swish

中图分类号: 

  • TP391
[1]DA S T,KOZAKEVICIUS A J,RODRIGUES C R.Single-channel EEG sleep stage classification based on a streamlined set of statistical features in wavelet domain[J].Medical & Biological Engineering & Computing,2017,55(2):1-10.
[2]TSINALIS O,MATTHEWS P M,GUO Y K.Automatic sleep stage scoring using time-frequency analysis and stacked sparse autoencoders[J].Annals of Biomedical Engineering,2016,44(5):1587-1597.
[3]MONIKA P,POLAK A G.Effect of Feature Extraction on Automatic Sleep Stage Classification by Artificial Neural Network[J].Metrology & Measurement Systems,2017,24(2):229-240.
[4]LI C,CHAI Y M,NAN X F,et al.Research on Problem Classification Method Based on Deep Learning[J].Computer Science,2016,43(12):115-119.(in chinese)
李超,柴玉梅,南晓斐,等.基于深度学习的问题分类方法研究[J].计算机科学,2016,43(12):115-119.
[5]WANG Z X,TENG S H,LIU G D,et al.Hierarchical sparse representation with deep dictionary for multi-modal classification[J].Neurocomputing,2017,253(C):65-69.
[6]WANG Z G,ZHAO Z S,WENG S F,et al.Incremental multiple instance outlier detection[J].Neural Computing & Applications,2015,26(4):957-968.
[7]ZHAO Z S,FENG X,WEI F,et al.Learning Representative
Features for Robot Topological Localization[J].International Journal of Advanced Robotic Systems,2013,10(4):1-12
[8]ZHANG Q L,ZHAO D,CHI X B.Review for Deep Learning Based on Medical Imaging Diagnosis[J].Computer Science,2017,44(Z11):1-7.(in Chinese)
张巧丽,赵地,迟学斌.基于深度学习的医学影像诊断综述[J].计算机科学,2017,44(Z11):1-7.
[9]TSINALIS O,MATTHEWS P M,GUO Y K,et al.Automatic sleep stage scoring with single-channel EEG using convolutional neural networks[EB/OL].[2016-10-05].https://arxiv.org/abs/1610.01683.
[10]SUPRATAK A,DONG H,WU C,et al.DeepSleepNet:a model for automatic sleep stage scoring based on raw single-channel EEG[EB/OL].[2017-08-03].https://arxiv.org/abs/1703.04046v2.
[11]HE K M,ZHANG X Y,REN S Q,et al.Deep Residual Learning for Image Recognition[C]∥Computer Vision and Pattern Re-cognition.IEEE,2016:770-778.
[12]RAMACHANDRAN P,ZOPH B,LE Q V.Swish:a self-gated activation function[EB/OL].[2017-10-27].https://arxiv.org/abs/1710.05941v2.
[13]HU S G,LIANG Y F,MA L T,et al.MSMOTE:Improving
Classification Performance When Training Data is Imbalanced[C]∥International Workshop on Computer Science & Engineering.IEEE Computer Society,2009:13-17.
[14]COHEN M X.Analyzing neural time series data :theory and practice[M].Massachusetts:MIT Press,2014.
[15]IOFFE S,SZEGEDY C.Batch normalization:accelerating deep network training by reducing internal covariate shift[C]∥International Conference on Machine Learning.2015:448-456.
[16]JOZEFOWICZ R,ZAREMBA W,SUTSKEVER I.An empirical exploration of recurrent network architectures[C]∥Internatio-nal Conference on International Conference on Machine Lear-ning.2015:2342-2350.
[1] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[3] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[4] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[5] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[6] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[7] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[8] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[9] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[10] 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木.
中文预训练模型研究进展
Advances in Chinese Pre-training Models
计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[11] 周慧, 施皓晨, 屠要峰, 黄圣君.
基于主动采样的深度鲁棒神经网络学习
Robust Deep Neural Network Learning Based on Active Sampling
计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[12] 苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫.
小样本雷达辐射源识别的深度学习方法综述
Survey of Deep Learning for Radar Emitter Identification Based on Small Sample
计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[13] 刘伟业, 鲁慧民, 李玉鹏, 马宁.
指静脉识别技术研究综述
Survey on Finger Vein Recognition Research
计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056
[14] 孙福权, 崔志清, 邹彭, 张琨.
基于多尺度特征的脑肿瘤分割算法
Brain Tumor Segmentation Algorithm Based on Multi-scale Features
计算机科学, 2022, 49(6A): 12-16. https://doi.org/10.11896/jsjkx.210700217
[15] 康雁, 徐玉龙, 寇勇奇, 谢思宇, 杨学昆, 李浩.
基于Transformer和LSTM的药物相互作用预测
Drug-Drug Interaction Prediction Based on Transformer and LSTM
计算机科学, 2022, 49(6A): 17-21. https://doi.org/10.11896/jsjkx.210400150
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!