计算机科学 ›› 2021, Vol. 48 ›› Issue (6A): 603-607.doi: 10.11896/jsjkx.201000035
钱基德1,2, 熊仁和1,2, 王乾垒1,2, 杜冬1,2, 王在俊1,2, 钱基业3
QIAN Ji-de1,2, XIONG Ren-he1,2, WANG Qian-lei1,2, DU Dong1,2, WANG Zai-jun1,2, QIAN Ji-ye3
摘要： 眼是人心理活动和思想在外观上的重要表现形式,文中通过使用高速图像采集系统跟踪飞行员的眼动轨迹来分析其心理行为,以研究飞行员在训练过程中的注意力情况。随着低功耗嵌入式设备、高速5G网络的逐渐成熟,已逐步进入“万物互联”新时代,基于此,提出采用边缘计算设备评估飞行训练效果的解决方案。该方案介绍了一种基于边缘计算架构的实时眼动跟踪系统,采用高速CMOS图像传感器采集眼部图像,提出了一种基于MobileNet的轻量级网络结构快速定位瞳孔位置,然后利用NVIDIA Jetson Nano板卡实现在连续视频图像中定位瞳孔并计算出注视点的功能,以获得眼动视觉焦点轨迹。实验结果表明,该边缘计算系统构成简单,且能满足实时眼动跟踪的要求,为实现实时心理行为分析提供了一种新的有效方法,给改进飞行训练效果提供了重要参考依据。
中图分类号:
| [1] KLAPROTH O W,HALBRÜGGE M,KROL L R,et al.ANeuroadaptive Cognitive Model for Dealing With Uncertainty in Tracing Pilots' Cognitive State[J].Topics in Cognitive Science,2020,12(3):1012-1029. [2] QAZI A,QAZI J,NASSER K,et al.Analyzing situationalawareness through public opinion to predict adoption of social distancing amid pandemic COVID-19[J].Journal of Medical Virology,2020,92(7):849-855. [3] KLAPROTH O W,VERNALEKEN C,KROL L R,et al.Tracing Pilots' Situation Assessment by Neuroadaptive Cognitive Modeling[J].Frontiers in Neuroscience,2020,14:795. [4] LU T,LOU Z,SHAO F,et al.Attention allocation in pilotsbased on climbing and circling mission behavior[J].Psychological Research,2021,85(3):1136-1145. [5] CHRISTOPHE A L,ALMOCTAR L,OLIVIER L,et al.Detecting ambient/focal visual attention in professional airline pilots with a modified Coefficient K:a full flight simulator study[C]//ACM Symposium on Eye Tracking Research and Applications.2020:1-6. [6] WANG F J,TIAN M,HUANG Y P,et al.Classification Model of Visual Attention Based on Eye Movement Data[J].Computer Science,2016,43(1):85-88,115. [7] LEE K F,CHEN Y L,YU C W,et al.Gaze Tracking and Point Estimation Using Low-Cost Head-Mounted Devices[J].Sensors,2020,20(7):1917. [8] LI B,FU H,WEN D,et al.Etracker:A mobile gaze-tracking system with near-eye display based on a combined gaze-tracking algorithm[J].Sensors,2018,18(5):1626. [9] BROUSSEAU B,ROSE J,EIZENMAN M.Hybrid Eye-Tracking on a Smartphone with CNN Feature Extraction and an Infrared 3D Model[J].Sensors,2020,20(2):543. [10] ELLEUCH H,WALI A,ALIMI A M.Smart tablet monitoring by a real-time head movement and eye gestures recognition system[C]//2014 International Conference on Future Internet of Things and Cloud.IEEE,2014:393-398. [11] JI H,ALFARRAJ O,TOLBA A.Artificial Intelligence-Empowered Edge of Vehicles:Architecture,Enabling Technologies,and Applications[J].IEEE Access,2020,8:61020-61034. [12] MENDIBOURE L,CHALOUF M A,KRIEF F.Towards a 5G vehicular architecture[C]//International Workshop on Communication Technologies for Vehicles.Springer,Cham,2019:3-15. [13] GUO S,CHEN C,WANG J,et al.Rod-revenue:Seeking strategies analysis and revenue prediction in ride-on-demand service using multi-source urban data[J].IEEE Transactions on Mobile Computing,2019,19(9):2202-2220. [14] LIN P,SONG Q,JAMALIPOUR A.Multidimensional cooperative caching in CoMP-integrated ultra-dense cellular networks[J].IEEE Transactions on Wireless Communications,2019,19(3):1977-1989. [15] SITTÓN-CANDANEDO I.Edge Computing:A Review of Application Scenarios[C]//International Symposium on Distributed Computing and Artificial Intelligence.Springer,Cham,2019:197-200. [16] XU X,LIU Q,LUO Y,et al.A computation offloading method over big data for IoT-enabled cloud-edge computing[J].Future Generation Computer Systems,2019,95:522-533. [17] KUMAR N,ZEADALLY S,RODRIGUES J J P C.Vehicular delay-tolerant networks for smart grid data management using mobile edge computing[J].IEEE Communications Magazine,2016,54(10):60-66. [18] NASTIC S,RAUSCH T,SCEKIC O,et al.A serverless real-time data analytics platform for edge computing[J].IEEE Internet Computing,2017,21(4):64-71. [19] POISSANT A,CASTANO L,XU H.Mitigation of Ground Impact Hazard for Safe Unmanned Aerial Vehicle Operations[J].Journal of Aerospace Information Systems,2020,17(12):647-658. [20] LI X,WAN J,DAI H N,et al.A hybrid computing solution and resource scheduling strategy for edge computing in smart manufacturing[J].IEEE Transactions on Industrial Informatics,2019,15(7):4225-4234. [21] ZOU Y H,GUAN P J,YANG B,et al.Rapid Eye MovementTracking System Based on FPGA and Projection Algorithm[J].Advanced Engineering Sciences,2016,48(3):100-106. |
| [1] | 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺. 时序知识图谱表示学习 Temporal Knowledge Graph Representation Learning 计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204 |
| [2] | 饶志双, 贾真, 张凡, 李天瑞. 基于Key-Value关联记忆网络的知识图谱问答方法 Key-Value Relational Memory Networks for Question Answering over Knowledge Graph 计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277 |
| [3] | 孙慧婷, 范艳芳, 马孟晓, 陈若愚, 蔡英. VEC中基于动态定价的车辆协同计算卸载方案 Dynamic Pricing-based Vehicle Collaborative Computation Offloading Scheme in VEC 计算机科学, 2022, 49(9): 242-248. https://doi.org/10.11896/jsjkx.210700166 |
| [4] | 汤凌韬, 王迪, 张鲁飞, 刘盛云. 基于安全多方计算和差分隐私的联邦学习方案 Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy 计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108 |
| [5] | 王剑, 彭雨琦, 赵宇斐, 杨健. 基于深度学习的社交网络舆情信息抽取方法综述 Survey of Social Network Public Opinion Information Extraction Based on Deep Learning 计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099 |
| [6] | 郝志荣, 陈龙, 黄嘉成. 面向文本分类的类别区分式通用对抗攻击方法 Class Discriminative Universal Adversarial Attack for Text Classification 计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077 |
| [7] | 姜梦函, 李邵梅, 郑洪浩, 张建朋. 基于改进位置编码的谣言检测模型 Rumor Detection Model Based on Improved Position Embedding 计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046 |
| [8] | 孙奇, 吉根林, 张杰. 基于非局部注意力生成对抗网络的视频异常事件检测方法 Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection 计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061 |
| [9] | 胡艳羽, 赵龙, 董祥军. 一种用于癌症分类的两阶段深度特征选择提取算法 Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification 计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092 |
| [10] | 程成, 降爱莲. 基于多路径特征提取的实时语义分割方法 Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction 计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157 |
| [11] | 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木. 中文预训练模型研究进展 Advances in Chinese Pre-training Models 计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018 |
| [12] | 周慧, 施皓晨, 屠要峰, 黄圣君. 基于主动采样的深度鲁棒神经网络学习 Robust Deep Neural Network Learning Based on Active Sampling 计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044 |
| [13] | 苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫. 小样本雷达辐射源识别的深度学习方法综述 Survey of Deep Learning for Radar Emitter Identification Based on Small Sample 计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138 |
| [14] | 于滨, 李学华, 潘春雨, 李娜. 基于深度强化学习的边云协同资源分配算法 Edge-Cloud Collaborative Resource Allocation Algorithm Based on Deep Reinforcement Learning 计算机科学, 2022, 49(7): 248-253. https://doi.org/10.11896/jsjkx.210400219 |
| [15] | 李梦菲, 毛莺池, 屠子健, 王瑄, 徐淑芳. 基于深度确定性策略梯度的服务器可靠性任务卸载策略 Server-reliability Task Offloading Strategy Based on Deep Deterministic Policy Gradient 计算机科学, 2022, 49(7): 271-279. https://doi.org/10.11896/jsjkx.210600040 |
|
||
首页