Computer Science ›› 2023, Vol. 50 ›› Issue (6A): 220600128-8.doi: 10.11896/jsjkx.220600128

• Artificial Intelligence • Previous Articles     Next Articles

EEG Emotion Recognition Based on Multiple Directed Weighted Graph and ConvolutionalNeural Network

LUO Ruiqi, YAN Jinlin, HU Xinrong, DING Lei   

  1. School of Computer Science and Artificial Intelligence,Wuhan Textile University,Wuhan 430200,China
  • Online:2023-06-10 Published:2023-06-12
  • About author:LUO Ruiqi,born in 1989,Ph.D,is a member of China Computer Federation.His main research interests include pattern recognition,image recognition and machine learning. HU Xinrong,born in 1973,Ph.D,professor,is a member of China Computer Federation.Her main research interests include image and processing and image computing.
  • Supported by:
    Outstanding Young and Middle-aged Scientific and Technological Innovation Team Project of Colleges and Universities in Hubei Province(T201807) and Key Projects of Scientific Research Plan of Hubei Provincial Department of Education(D20191708).

Abstract: In recent years,research on EEG signals applied to emotion recognition has received extensive attention,and mapping time series into visibility graph representation can effectively perform EEG emotion recognition through the metric of edges and nodes of the visibility graph.Traditional visibility graph algorithms ignore the correlation between multi-channel EEG signals,and it is difficult to retain the complex feature information on the time series.Therefore,this paper proposes a method to extract EEG signal features from multiple directed weighted visibility graphs and use EEG signal features for emotion recognition.Firstly,the EEG signal is converted into a directed weighted network graph to enhance the feature representation of the signal,the complex network structure is characterized using weighted clustering coefficients,the EEG connection matrix is established with multiple complex networks,and finally the convolutional neural network is used for feature learning,and the emotion recognition results are obtained through learning.The complex network model constructed by multiple directed weighted visibility maps achieves 93.85% accuracy in public dataset validation,which is better than the existing traditional visibility graph methods,and the multiple weighted visibility graph improves the emotion recognition accuracy by 9.4% compared with univariate visibility graph.Experimental results show that the method is also applicable to cross subject data and has good robustness.

Key words: Emotion recognition, EEG signal, Multiple visible graph, Convolutional neural network, Clustering coefficient

CLC Number: 

  • TP391
[1]LI Y,ZHENG W,WANG L,et al.From regional to globalbrain:A novel hierarchical spatial-temporal neural network model for EEG emotion recognition[J].IEEE Transactions on Affective Computing,2019,13(2):568-578.
[2]CAO Y,CAI L,WANG J,et al.Characterization of complexity in the electroencephalograph activity of Alzheimer′s disease based on fuzzy entropy[J].Chaos:An Interdisciplinary Journal of Nonlinear Science,2015,25(8):083116.
[3]RODRIGUEZ-BERMUDEZ G,GARCIA-LAENCINA P J.Analysis of EEG signals using nonlinear dynamics and chaos:a review[J].Applied Aathematics & Information Sciences,2015,9(5):2309.
[4]SMALL M,ZHANG J,XU X.Transforming time series into complex networks[C]//International Conference on Complex Sciences.Berlin:Springer,2009:2078-2089.
[5]XIANG R,ZHANG J,XU X K,et al.Multiscale characterization of recurrence-based phase space networks constructed from time series[J].Chaos:An Interdisciplinary Journal of Nonlinear Science,2012,22(1):013107.
[6]SPORNS O.The human connectome:a complex network[J].Annals of the New York Academy of Sciences,2011,1224(1):109-125.
[7]ZANGENEH S M,MAGHOOLI K,SETAREHDAN S K,et al.Emotion classification through nonlinear EEG analysis using machine learning methods[J].Int.Clin.Neurosci.J,2018,5:135-149.
[8]HARMON-JONES E,GABLE P A,PETERSON C K.The role of asymmetric frontal cortical activity in emotion-related phenomena:A review and update[J].Biological Psychology,2010,84(3):451-462.
[9]PAUL S,MAZUMDER A,GHOSH P,et al.EEG based emo-tion recognition system using MFDFA as feature extractor[C]//2015 International Conference on Robotics,Automation,Control and Embedded Systems(RACE).IEEE,2015:1-5.
[10]ZHENG W L,ZHU J Y,LU B L.Identifying stable patterns over time for emotion recognition from EEG[J].IEEE Transactions on Affective Computing,2017,10(3):417-429.
[11]KOELSTRA S,MUHL C,SOLEYMANI M,et al.Deap:A database for emotion analysis;using physiological signals[J].IEEE Transactions on Affective Computing,2011,3(1):18-31.
[12]ZHENG W L,LU B L.Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks[J].IEEE Transactions on Autonomous Mental Development,2015,7(3):162-175.
[13]ALGUMAEI M,HETTIARACHCHI I T,VEERABHADRAPPA R,et al.Wavelet Packet Energy Features for EEG-Based Emotion Recognition[C]//2021 IEEE International Conference on Systems,Man,and Cybernetics(SMC).IEEE,2021:1935-1940.
[14]JOSHI V M,GHONGADE R B.EEG based emotion detection using fourth order spectral moment and deep learning[J].Biomedical Signal Processing and Control,2021,68:102755.
[15]LACASA L,LUQUE B,BALLESTEROS F,et al.From timeseries to complex networks:The visibility graph[J].Procee-dings of the National Academy of Sciences,2008,105(13):4972-4975.
[16]LUQUE B,LACASA L,BALLESTEROS F,et al.Horizontal visibility graphs:Exact results for random time series[J].Physical Review E,2009,80(4):046103.
[17]WANG J,YANG C,WANG R,et al.Functional brain networks in Alzheimer’s disease:EEG analysis based on limited penetrable visibility graph and phase space method[J].Physica A:Statistical Mechanics and its Applications,2016,460:174-187.
[18]ZHU G,LI Y,WEN P P.Epileptic seizure detection in EEGs signals using a fast weighted horizontal visibility algorithm[J].Computer Methods and Programs in Biomedicine,2014,115(2):64-75.
[19]SAMANTA K,CHATTERJEE S,BOSE R.Cross-subject motor imagery tasks EEG signal classification employing multiplex weighted visibility graph and deep feature extraction[J].IEEE Sensors Letters,2019,4(1):1-4.
[20]LI X,SONG D,ZHANG P,et al.Exploring EEG features incross-subject emotion recognition[J].Frontiers in neuroscience,2018,12:162.
[21]LU Y,WANG M,WU W,et al.Dynamic entropy-based pattern learning to identify emotions from EEG signals across indivi-duals[J].Measurement,2020,150:107003.
[22]CIMTAY Y,EKMEKCIOGLU E.Investigating the use of pretrained convolutional neural network on cross-subject and cross-dataset EEG emotion recognition[J].Sensors,2020,20(7):2034.
[23]YAO L,WANG M,LU Y,et al.EEG-Based Emotion Recognition by Exploiting Fused Network Entropy Measures of Complex Networks across Subjects[J].Entropy,2021,23(8):984.
[24]LI X,ZHAO Z,SONG D,et al.Latent factor decoding of multi-channel EEG for emotion recognition through autoencoder-like neural networks[J].Frontiers in Neuroscience,2020,14:87.
[25]YANG F,ZHAO X,JIANG W,et al.Multi-method fusion ofcross-subject emotion recognition based on high-dimensional EEG features[J].Frontiers in Computational Neuroscience,2019,13:53.
[26]ZHANG T,ZHENG W,CUI Z,et al.Spatial-temporal recurrent neural network for emotion recognition[J].IEEE Transactions on Cybernetics,2018,49(3):839-847.
[27]SONG T,ZHENG W,SONG P,et al.EEG emotion recognition using dynamical graph convolutional neural networks[J].IEEE Transactions on Affective Computing,2018,11(3):532-541.
[1] ZHAO Ran, YUAN Jiabin, FAN Lili. Medical Ultrasound Image Super-resolution Reconstruction Based on Video Multi-frame Fusion [J]. Computer Science, 2023, 50(7): 143-151.
[2] CUI Yunsong, WU Ye, XU Xiaoke. Decoupling Analysis of Network Structure Affecting Propagation Effect [J]. Computer Science, 2023, 50(7): 368-375.
[3] LUO Huilan, LONG Jun, LIANG Miaomiao. Attentional Feature Fusion Approach for Siamese Network Based Object Tracking [J]. Computer Science, 2023, 50(6A): 220300237-9.
[4] LI Han, HOU Shoulu, TONG Qiang, CHEN Tongtong, YANG Qimin, LIU Xiulei. Entity Relation Extraction Method in Weapon Field Based on DCNN and GLU [J]. Computer Science, 2023, 50(6A): 220200112-7.
[5] XIONG Haojie, WEI Yi. Study on Multibeam Sonar Elevation Data Prediction Based on Improved CNN-BP [J]. Computer Science, 2023, 50(6A): 220100161-4.
[6] WANG Xiya, ZHANG Ning, CHENG Xin. Review on Methods and Applications of Text Fine-grained Emotion Recognition [J]. Computer Science, 2023, 50(6A): 220900137-7.
[7] HUANG Yujiao, CHEN Mingkai, ZHENG Yuan, FAN Xinggang, XIAO Jie, LONG Haixia. Text Classification Based on Weakened Graph Convolutional Networks [J]. Computer Science, 2023, 50(6A): 220700039-5.
[8] CUI Lin, CUI Chenlu, LIU Zhengwei, XUE Kai. Speech Emotion Recognition Based on Improved MFCC and Parallel Hybrid Model [J]. Computer Science, 2023, 50(6A): 220800211-7.
[9] LEI Ying, LIU Feng. LDM-EEG:A Lightweight EEG Emotion Recognition Method Based on Dual-stream Structure Scaling and Multiple Attention Mechanisms [J]. Computer Science, 2023, 50(6A): 220300262-9.
[10] XU Changqian, WANG Dong, SU Feng, ZHANG Jun, BIAN Haifeng, LI Long. Image Recognition Method of Transmission Line Safety Risk Assessment Based on MultidimensionalData Coupling [J]. Computer Science, 2023, 50(6A): 220500032-6.
[11] WANG Jinwei, ZENG Kehui, ZHANG Jiawei, LUO Xiangyang, MA Bin. GAN-generated Face Detection Based on Space-Frequency Convolutional Neural Network [J]. Computer Science, 2023, 50(6): 216-224.
[12] ZHANG Xue, ZHAO Hui. Sentiment Analysis Based on Multi-event Semantic Enhancement [J]. Computer Science, 2023, 50(5): 238-247.
[13] WANG Lin, MENG Zuqiang, YANG Lina. Chinese Sentiment Analysis Based on CNN-BiLSTM Model of Multi-level and Multi-scale Feature Extraction [J]. Computer Science, 2023, 50(5): 248-254.
[14] YE Han, LI Xin, SUN Haichun. Convolutional Network Entity Missing Detection Method Combined with Gated Mechanism [J]. Computer Science, 2023, 50(5): 262-269.
[15] CHANG Liwei, LIU Xiujuan, QIAN Yuhua, GENG Haijun, LAI Yuping. Multi-source Fusion Network Security Situation Awareness Model Based on Convolutional Neural Network [J]. Computer Science, 2023, 50(5): 382-389.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!