计算机科学 ›› 2020, Vol. 47 ›› Issue (4): 112-118.doi: 10.11896/jsjkx.190200342

所属专题: 医学图像

• 计算机图形学&多媒体 • 上一篇    下一篇

一种基于脑电信号的眼动方向分类方法

程时伟1, 陈一健1, 徐静如1, 张柳新2, 吴剑锋3, 孙凌云4   

  1. 1 浙江工业大学计算机科学与技术学院 杭州310023;
    2 联想研究院 北京100085;
    3 浙江工业大学工业设计研究院 杭州310023;
    4 浙江大学CAD&CG国家重点实验室 杭州310027
  • 收稿日期:2019-04-26 出版日期:2020-04-15 发布日期:2020-04-15
  • 通讯作者: 程时伟(swc@zjut.edu.cn)
  • 基金资助:
    国家重点研发计划课题(2016YFB1001403);国家自然科学基金(61772468,61672451)

Approach to Classification of Eye Movement Directions Based on EEG Signal

CHENG Shi-wei1, CHEN Yi-jian1, XU Jing-ru1, ZHANG Liu-xin2, WU Jian-feng3, SUN Ling-yun4   

  1. 1 School of Computer Science and Technology,Zhejiang University of Technology,Hangzhou 310023,China;
    2 Lenovo Research,Beijing 100085,China;
    3 Institute of Industrial Design,Zhejiang University of Technology,Hangzhou 310023,China;
    4 State Key Lab of CAD&CG,Zhejiang University,Hangzhou 310027,China
  • Received:2019-04-26 Online:2020-04-15 Published:2020-04-15
  • Contact: CHENG Shi-wei,born in 1981,Ph.D,professor,Ph.D supervisor,is senior member of China Computer Federation.His main research interests include human-computer interaction.
  • Supported by:
    This work was supported by the National Key Research & Development Program of China (2016YFB1001403) and National Natural Science Foundation of China (61772468,61672451).

摘要: 为了提高基于眼电的眼动方向的识别准确性,文中利用包含眼电伪迹的脑电信号,提出了一种新的眼动方向分类方法。首先,在10-20国际标准导联配置下,通过脑电仪采集靠近人脑额叶处的AF7,F7,FT7,T7,AF8,F8,FT8,T8这8个通道的脑电信号;然后,通过基线移除、归一化、最小二乘法降噪等进行数据预处理;最后,采用支持向量机的方法进行眼动方向的多次二分类,并使用投票策略实现眼动方向的四分类识别。实验结果表明,所提方法进行眼动方向分类时,在上、下、左、右4个方向上的分类率分别达到了78.47%,72.22%,84.03%,79.86%,平均分类率达到了78.65%。与已有的分类方法相比,所提方法的分类准确率更高,分类算法的实现过程更简单,这进一步验证了利用脑电信号识别眼动方向的可行性和有效性。

关键词: 脑电, 脑机接口, 人机交互, 眼电, 眼动跟踪

Abstract: In order to improve the accuracy of eye movement directions identification based on electro-oculogram (EOG) signals,this paper utilized the electrooculogram (EEG) signals containing EOG artifacts and proposed a new approach to classify eye movement directions.Firstly,EEG signals from the 8 channels in the frontal lobe of the human brain are collected,and EEG data pre-processing is made ,including data normalization and least squares based denoising.Then support vector machine based methodis applied to perform multiple binary-classification,and finally voting strategy is used to solve four-classification problems,thus achieving eye movement directions identification.The experiment results show when using the approach of this paper to classify eye movement directions,the classification accuracy rates in the upper,lower,left and right directions are 78.47%,72.22%,84.03%,79.86% respectively,and the average classification accuracy rates reach 78.65%.In addition,compared with the existed classification methods,the classification accuracy rate of this paper is higher,and the classification algorithm is simpler.It is validated the feasibility and effectiveness of using EEG signals to identify eye movement directions.

Key words: Brain-computer interface, Electroencephalogram, Electro-oculogram, Eye tracking, Human-computer interaction

中图分类号: 

  • TP311
[1]SCHALK G,MCFARLAND D J,HINTERBERGER T,et al.BCI2000:a general-purpose brain-computer interface (BCI) system [J].IEEE Transactions on Biomedical Engineering,2004,51(6):1034-1043.
[2]BELKACEM A N,SHIN D,KAMBARA H,et al.Online classification algorithm for eye-movement-based communication systems using two temporal EEG sensors[J].Biomedical Signal Processing & Control,2015,16:40-47.
[3]BAI X,WANG X,ZHENG S,et al.The offline feature extraction of four-class motor imagery EEG based on ICA and Wavelet-CSP[C]// Proceeding of the 33rd Chinese Control Confe-rence (CCC).Nanjing:IEEE,2014:7189-7194.
[4]WANG L,WU X P,GAO X P.Analysis and classification of four-class motor imagery EEG data[J].Computer Technology and Development,2008,18(10):23-26.
[5]BAREA R,BOQUETE L,MAZO M,et al.Wheelchair guidance strategies using EOG [J].Journal of Intelligent & Robotic Systems,2002,34(3):279-299.
[6]FATOURECHI M,BASHASHATI A,WARD R K,et al.EMG and EOG artifacts in brain computer interface systems:A survey[J].Clinical Neurophysiology,2007,118(3):480-494.
[7]KUMAR B K,PRASAD K,ALEKHYA D.Performance comparision of various thresholding techniques on the removal of ocular artifacts in The EEG signals[C]//2016 International Confe-rence on Inventive Computation Technologies (ICICT).Coimbatore:IEEE,2016:1-5.
[8]PLÖCHL M,OSSANDMÒN J P,KÖNIG P.Combining EEGand eye tracking:identification,characterization,and correction of eye movement artifacts in electroencephalographic data [J].Frontiers in Human Neuroscience,2012,6:278.
[9]DIMIGEN O,SOMMER W,HOHLFELD A,et al.Coregistration of eye movements and EEG in natural reading:analyses and review [J].Journal of Experimental Psychology:General,2011,140(4):552.
[10]GOMEZ-GIL J,SAN-JOSE-GONZALEZ I,NICOLAS-ALONSO L F,et al.Steering a tractor by means of an EMG-based human-machine interface [J].Sensors,2011,11(7):7110-7126.
[11]YAGI T.Eye-gaze interfaces using electro-oculography (EOG)[C]// The 2010 Workshop on Eye Gaze in Intelligent Human Machine Interaction.Hong Kong:ACM,2010:28-32.
[12]AI G,SATO N,SINGH B,et al.Direction and viewing area-sensitive influence of EOG artifacts revealed in the EEG topographicpattern analysis [J].Cogn Neurodyn,2016,10(4):301-314.
[13]ROBERT H,KISE K,AUGEREAU O.Real-time wordometer demonstration using commercial EoG glasses[C]//Proceedings of the 2017 ACM International Symposium on Wearable Computers.ACM,2017:277-280.
[14]LEE J,YEO H S,STARNER T,et al.Automated Data Gathering and Training Tool for Personalized Itchy Nose[C]//Proceedings of the 9th Augmented Human International Conference.ACM,2018:1-3.
[15]BELKACEM A N,HIROSE H,YOSHIMURA N,et al.Classification of four eye directions from EEG signals for eye-movement-based communication systems [J].Journal of Medical & Biological Engineering,2014,34(6):581-588[16]VAPNIK V N,VAPNIK V.Statistical learning theory [M].New York:Wiley,1998.
[17]SOMAN S.Learning from low training data using classifierswith derivative constraints[C]//Proceedings of the ACM India Joint International Conference on Data Science and Management of Data.ACM,2019:86-93.
[18]ZHANG X G.Introduction to statistical learning theory andsupport vector machines[J].Acta Automatica Sinica,2000,26(1):32-42.
[19]SUN H,ZHANG Y,GLUCKMAN B J,et al.Optimal-channel selection algorithms in mental tasks based brain-computer interface[C]// Proceedings of the 2018 8th International Conference on Bioscience,Biochemistry and Bioinformatics.New York:ACM,2018:118-123.
[20]RAMOSER H,MULLER-GERKING J,PFURTSCHELLERG.Optimal spatial filtering of single trial EEG during imagined hand movement [J].IEEE Transactions on Rehabilitation Engineering,2000,8(4):441-446.
[21]SU K,ROBBINS K A.Subject specific parameter selection for the EEG classifier using common spatial patterns[C]// Proceedings of the 2012 ACM Research in Applied Computation Symposium.New York:ACM,2012:68-69.
[22]ZHANG H,QIAO X Y.Research of fusion classification of EEG features for multi-Class motor imagery[J].Chinese Journal of Sensors and Actuators,2016,29(6):802-807.
[23]KAI K,KATSUTOSHI M,UEMA Y,et al.How much do you read?:counting the number of words a user reads using electrooculography[C]//Proceedings of the 6th Augmented Human International Conference.New York:ACM,2015:125-128.
[1] 杨炳新, 郭艳蓉, 郝世杰, 洪日昌.
基于数据增广和模型集成策略的图神经网络在抑郁症识别上的应用
Application of Graph Neural Network Based on Data Augmentation and Model Ensemble in Depression Recognition
计算机科学, 2022, 49(7): 57-63. https://doi.org/10.11896/jsjkx.210800070
[2] 李荪, 曹峰.
智能语音技术端到端框架模型分析和趋势研究
Analysis and Trend Research of End-to-End Framework Model of Intelligent Speech Technology
计算机科学, 2022, 49(6A): 331-336. https://doi.org/10.11896/jsjkx.210500180
[3] 高越, 傅湘玲, 欧阳天雄, 陈松龄, 闫晨巍.
基于时空自适应图卷积神经网络的脑电信号情绪识别
EEG Emotion Recognition Based on Spatiotemporal Self-Adaptive Graph ConvolutionalNeural Network
计算机科学, 2022, 49(4): 30-36. https://doi.org/10.11896/jsjkx.210900200
[4] 张继凯, 李琦, 王月明, 吕晓琪.
基于单目RGB图像的三维手势跟踪算法综述
Survey of 3D Gesture Tracking Algorithms Based on Monocular RGB Images
计算机科学, 2022, 49(4): 174-187. https://doi.org/10.11896/jsjkx.210700084
[5] 杜钰琳, 黄章瑞, 赵新灿, 刘晨阳.
SSVEP刺激数量对AR-BCI性能的影响
SSVEP Stimulus Number Effect on Performance of Brain-Computer Interfaces in Augmented Reality Glasses
计算机科学, 2021, 48(8): 309-314. https://doi.org/10.11896/jsjkx.200700219
[6] 朱晨爽, 程时伟.
虚拟现实环境下基于眼动跟踪的导航需求预测与辅助
Prediction and Assistance of Navigation Demand Based on Eye Tracking in Virtual Reality Environment
计算机科学, 2021, 48(8): 315-321. https://doi.org/10.11896/jsjkx.200500031
[7] 刘亮, 蒲浩洋.
基于LSTM的多维度特征手势实时识别
Real-time LSTM-based Multi-dimensional Features Gesture Recognition
计算机科学, 2021, 48(8): 328-333. https://doi.org/10.11896/jsjkx.210300079
[8] 钱基德, 熊仁和, 王乾垒, 杜冬, 王在俊, 钱基业.
边缘计算在飞行训练中的应用
Application of Edge Computing in Flight Training
计算机科学, 2021, 48(6A): 603-607. https://doi.org/10.11896/jsjkx.201000035
[9] 吴广智, 郭斌, 丁亚三, 成家慧, 於志文.
假消息认知机理研究综述
Cognitive Mechanisms of Fake News
计算机科学, 2021, 48(6): 306-314. https://doi.org/10.11896/jsjkx.201200194
[10] 柴冰, 李冬冬, 王喆, 高大启.
融合频率和通道卷积注意的脑电(EEG)情感识别
EEG Emotion Recognition Based on Frequency and Channel Convolutional Attention
计算机科学, 2021, 48(12): 312-318. https://doi.org/10.11896/jsjkx.201000141
[11] 王博石, 吴修诚, 胡馨艺, 张莉.
基于单通道脑电信号的疲劳检测系统
Fatigue Detection System Based on Single Channel EEG Signal
计算机科学, 2020, 47(5): 225-229. https://doi.org/10.11896/jsjkx.190400127
[12] 何艳, 张晨阳.
基于Unity的神经反馈干预系统设计与实现
Design and Implementation of Neurofeedback Intervention System Based on Unity
计算机科学, 2020, 47(11A): 579-583. https://doi.org/10.11896/jsjkx.200700153
[13] 程时伟, 齐文杰.
基于动态轨迹的眼动跟踪隐式标定方法
Dynamic Trajectory Based Implicit Calibration Method for Eye Tracking
计算机科学, 2019, 46(8): 282-291. https://doi.org/10.11896/j.issn.1002-137X.2019.08.047
[14] 王静, 司书建.
面向脑机接口技术的属性可撤销访问控制方案
Attribute Revocable Access Control Scheme for Brain-Computer Interface Technology
计算机科学, 2018, 45(9): 187-194. https://doi.org/10.11896/j.issn.1002-137X.2018.09.031
[15] 陈甜甜, 姚璜, 左明章, 田元, 杨梦婷.
基于深度信息的动态手势识别综述
Review of Dynamic Gesture Recognition Based on Depth Information
计算机科学, 2018, 45(12): 42-51. https://doi.org/10.11896/j.issn.1002-137X.2018.12.006
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!