计算机科学 ›› 2022, Vol. 49 ›› Issue (4): 30-36.doi: 10.11896/jsjkx.210900200
高越, 傅湘玲, 欧阳天雄, 陈松龄, 闫晨巍
GAO Yue, FU Xiang-ling, OUYANG Tian-xiong, CHEN Song-ling, YAN Chen-wei
摘要： 随着人机交互在计算机辅助领域的快速发展,脑电信号已成为情绪识别的主要手段。与此同时,图网络因其对拓扑结构数据的优秀表征能力,逐渐受到研究者们的广泛关注。为进一步提升图网络对多通道脑电信号的表征性能,文中结合脑电信号的稀疏性、不频繁性等多种特性,提出了一种基于时空自适应图卷积神经网络的脑电情绪识别方法(Self-Adaptive Brain Graph Convolutional Network with Spatiotemporal Attention,SABGCN-ST)。该方法通过引入时空注意力机制解决了情绪的稀疏性问题,并根据自适应学习的脑网络拓扑邻接矩阵,挖掘不同位置的电极通道之间的功能连接关系。最终模型基于图卷积操作进行图结构的特征学习,以实现对脑电信号的情绪预测。在DEAP和SEED两个脑电信号公开数据集上开展了大量实验,实验结果证明,SABGCN-ST相比基线模型在准确率上具有显著的优势,平均情绪识别准确率达到84.91%。
中图分类号:
| [1] COWIE R,DOUGLAS C E,TSAPATSOULIS N,et al.Emo-tion recognition in human-computer interaction[J].IEEE Signal Processing Magazine,2001,18(1):32-80. [2] ANDERSON K,MCOWAN P.A real-time automated systemfor the recognition of human facial expressions[J].IEEE Tran-sactions on Systems,Man,and Cybernetics,Part B (Cyberne-tics),2006,36(1):96-105. [3] HUANG X,ZHAO G,HONG X,et al.Spontaneous facial micro-expression analysis using spatiotemporal completed local quantized patterns[J].Neurocomputing,2016,175:564-578. [4] HUANG X,WANG S,ZHAO G,et al.Facial micro-expression recognition using spatiotemporal local binary pattern with integral projection[C]// IEEE International Conference on Computer Vision Workshop.2015:1-9. [5] HUANG X,WANG S,LIU X,et al.Discriminative spatiotemporal local binary pattern with revisited integral projection for spontaneous facial micro-expression recognition[J].IEEE Transactions on Affective Computing,2017,10(1):32-47. [6] LIU Y,ZHANG J,YAN W,et al.A main directional mean optical flow feature for spontaneous micro-expression recognition[J].IEEE Transactions on Affective Computing,2016,7(4):299-310. [7] YAN J,ZHENG W,XIN M,et al.Integrating facial expression and body gesture in videos for emotion recognition[J].IEICE Transactions on Information and Systems,2014,E97-D(3):610-613. [8] ANG J,DHILLON R,KRUPSKI A,et al.Prosody-based automatic detection of annoyance and frustration in human-computer dialog[C]//International Conference on Spoken Language Processing.2002:2037-2040. [9] ZHENG W.Multichannel EEG-based emotion recognition viagroup sparse canonical correlation analysis[J].IEEE Transactions on Cognitive and Developmental Systems,2017,9(3):281-290. [10] CHENG B,LIU G.Emotion recognition from surface EMG signal using wavelet transform and neural network[C]// 2nd International Conference on Bioinformatics and Biomedical Engineering.2008:1363-1366. [11] AGRAFIOTI F,HATZINAKOS D,ANDERSON A.ECG pattern analysis for emotion detection[J].IEEE Transactions on Affective Computing,2012,3(1):102-115. [12] NOBLE W S.What is a support vector machine?[J].Nature Biotechnology,2006,24(12):1565-1567. [13] MERT A,AKAN A.Emotion recognition from EEG signals by using multivariate empirical mode decomposition[J].PatternAnalysis and Applications,2018,21(1):81-89. [14] ZHENG W L,LU B.Investigating critical frequency bands and channels for eeg-based emotion recognition with deep neural networks[J].IEEE Transactions on Autonomous Mental Development,2015,7(3):162-175. [15] LI Y,ZHENG W,ZONG Y,et al.A bi-hemisphere domain adversarial neural network model for EEG emotion recognition[J].IEEE Transactions on Affective Computing,2021,12(2):494-504. [16] LI Y,ZHENG W,WANG L,et al.From regional to globalbrain:a novel hierarchical spatial-temporal neural network mo-del for EEG emotion recognition[J/OL].IEEE Transactions on Affective Computing.https://doi.ieeecomputersociety.org/10.1109/TAFFC.2019.2922912. [17] SONG T,ZHENG W,SONG P,et al.EEG emotion recognition using dynamical graph convolutional neural networks[J].IEEE Transactions on Affective Computing,2018,11(3):532-541. [18] LI P,LIU H,SI Y,et al.EEG based emotion recognition bycombining functional connectivity network and local activations[J].IEEE Transactions on Biomedical Engineering,2019,66(10):2869-2881. |
| [1] | 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺. 时序知识图谱表示学习 Temporal Knowledge Graph Representation Learning 计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204 |
| [2] | 饶志双, 贾真, 张凡, 李天瑞. 基于Key-Value关联记忆网络的知识图谱问答方法 Key-Value Relational Memory Networks for Question Answering over Knowledge Graph 计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277 |
| [3] | 汤凌韬, 王迪, 张鲁飞, 刘盛云. 基于安全多方计算和差分隐私的联邦学习方案 Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy 计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108 |
| [4] | 李宗民, 张玉鹏, 刘玉杰, 李华. 基于可变形图卷积的点云表征学习 Deformable Graph Convolutional Networks Based Point Cloud Representation Learning 计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023 |
| [5] | 王剑, 彭雨琦, 赵宇斐, 杨健. 基于深度学习的社交网络舆情信息抽取方法综述 Survey of Social Network Public Opinion Information Extraction Based on Deep Learning 计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099 |
| [6] | 郝志荣, 陈龙, 黄嘉成. 面向文本分类的类别区分式通用对抗攻击方法 Class Discriminative Universal Adversarial Attack for Text Classification 计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077 |
| [7] | 姜梦函, 李邵梅, 郑洪浩, 张建朋. 基于改进位置编码的谣言检测模型 Rumor Detection Model Based on Improved Position Embedding 计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046 |
| [8] | 孙奇, 吉根林, 张杰. 基于非局部注意力生成对抗网络的视频异常事件检测方法 Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection 计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061 |
| [9] | 檀莹莹, 王俊丽, 张超波. 基于图卷积神经网络的文本分类方法研究综述 Review of Text Classification Methods Based on Graph Convolutional Network 计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064 |
| [10] | 杨炳新, 郭艳蓉, 郝世杰, 洪日昌. 基于数据增广和模型集成策略的图神经网络在抑郁症识别上的应用 Application of Graph Neural Network Based on Data Augmentation and Model Ensemble in Depression Recognition 计算机科学, 2022, 49(7): 57-63. https://doi.org/10.11896/jsjkx.210800070 |
| [11] | 胡艳羽, 赵龙, 董祥军. 一种用于癌症分类的两阶段深度特征选择提取算法 Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification 计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092 |
| [12] | 程成, 降爱莲. 基于多路径特征提取的实时语义分割方法 Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction 计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157 |
| [13] | 徐鸣珂, 张帆. Head Fusion:一种提高语音情绪识别的准确性和鲁棒性的方法 Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition 计算机科学, 2022, 49(7): 132-141. https://doi.org/10.11896/jsjkx.210100085 |
| [14] | 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木. 中文预训练模型研究进展 Advances in Chinese Pre-training Models 计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018 |
| [15] | 周慧, 施皓晨, 屠要峰, 黄圣君. 基于主动采样的深度鲁棒神经网络学习 Robust Deep Neural Network Learning Based on Active Sampling 计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044 |
|
||
首页