虚拟现实环境下基于眼动跟踪的导航需求预测与辅助

doi:10.11896/jsjkx.200500031

摘要/Abstract

摘要： 针对复杂虚拟现实场景中传统导航方法对用户支持不足和用户沉浸感较低等问题,文中提出了基于梯度提升迭代决策树的二分类模型,利用用户在虚拟现实环境中使用辅助导航时需要的眼动数据,来分析和预测用户在任务过程中是否需要辅助导航。根据用户的注视序列对该模型进行评估,得到用户需求判定方法的平均精确率和准确率分别为77.6%与77.2%。此外,文中借助所设计模型实现了一个导航辅助原型系统,通过对用户的眼动数据进行分类,来自动呈现导航辅助界面。实验结果表明,与传统的永久性辅助导航方法相比,新提出的自适应辅助导航具有更好的用户体验。

关键词: 导航, 人机交互, 虚拟现实, 眼动跟踪

Abstract: In order to solve the problems of insufficient user support and low user immersion in traditional navigation methods in complex virtual reality scenes, this paper proposes a binary classification model based on the gradient boost decision tree,which uses eye movement data before and after the user's need for auxiliary navigation in the VR environment to analyze and predict whether the user needs navigation during the task.The model is evaluated according to the user's gaze sequence,and the average precision and accuracy of the user demand judgment method are 77.6% and 77.2%,respectively.In addition,we implemente a navigation aid prototype system.By classifying the user's navigation requirement based on eye movement data,the user interface of the prototype system can automatically present the map for navigation.Experimental results showed that,compared with the traditional permanent assisted navigation method,the adaptive assisted navigation proposed in this paper can provide better user experience.

Key words: Eye tracking, Human computer interaction, Navigation, Virtual reality

中图分类号:

TP391

朱晨爽, 程时伟. 虚拟现实环境下基于眼动跟踪的导航需求预测与辅助[J]. 计算机科学, 2021, 48(8): 315-321. https://doi.org/10.11896/jsjkx.200500031

ZHU Chen-shuang, CHENG Shi-wei. Prediction and Assistance of Navigation Demand Based on Eye Tracking in Virtual Reality Environment[J]. Computer Science, 2021, 48(8): 315-321. https://doi.org/10.11896/jsjkx.200500031

参考文献

[1]ALGHOFAILI R,SAWAHATA Y,HUANG H K,et al.Lost in Style:Gaze-driven Adaptive Aid for VR Navigation[C]//CHI Conference.Association for Computing Machinery,New York,NY,USA,2019:1-12.
[2]VLCEK K,LACZO J.Neural correlates of Spatial Navigationchanges in Mild Cognitive Impairment and Alzheimer's Disease[J].Front Behav Neurosci,2014(8):89.
[3]LAURA P,DE LUCA M,RAFFAELLA N,et al.Navigational Style Influences Eye Movement Pattern during Exploration and Learning of an Environmental Map[J].Frontiers in Behavioral Neuroscience,2016(10):e43620.
[4]KEVIN S,PAI Y S,KUNZE K.Virtual gaze:exploring use of gaze as rich interaction method with virtual agent in interactive virtual reality content[C]//Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology.ACM,2018:130.
[5]BOYD L A E,GUPTA S,VIKMANI S B,et al.vrSocial:To-ward Immersive Therapeutic VR Systems for Children with Autism[C]//The 2018 CHI Conference.Association for Computing Machinery.New York,NY,USA,2018:1-12.
[6]KASAHARA S,ANDO M,SUGANUMA K,et al.ParallelEyes:Exploring Human Capability and Behaviors with Paralleled First Person View Sharing[C]//CHI Conference on Human Factors in Computing Systems.Association for Computing Machinery,New York,NY,USA,2016:1-2.
[7]GANDRUD J,INTERRANTE V.Predicting destination using head orientation and gaze direction during locomotion in VR[C]//Proceedings of the ACM Symposium on Applied Perception.ACM,2016:31-38.
[8]LEE J,CHEON M,MOON S E,et al.Peripersonal Space in Vir-tual Reality:Navigating 3D Space with Different Perspectives[C]//Symposium on User Interface Software & Technology.Association for Computing Machinery,New York,NY,USA,2016:207-208.
[9]SAHA D P,KNAPP R B,MARTIN T L.Affective feedback in a virtual reality based intelligent supermarket[C]//Adjunct Acm Joint Conference on Pervasive & Ubiquitous Computing.ACM,2017:646-653.
[10]ZHOU J B.Study and Implementation on the Algorithm of Eye Tracking System[D].Xi'an:Xidian University,2010.
[11]WU Y Y.Research on the Technology of Eye Tracking[D].Xi'an:Xidian University,2009.
[12]MIAO L F.Geometry Modeling and Rendering of Point Set Surface[D].Hangzhou:Zhejiang University,2005.
[13]ZHU M,WAN L,ZHANG Y Y,et al.From 3D Model to Holographic Model:Application of Intelligent Model in Urban Planning-Taking the Urban Planning Assistant System of Chaohu City as an Example[J].Journal of Anhui Jianzhu University,2019,27(5):36-43.
[14]LIN G L,CAO Y J,BAO Y F.Research on Roaming and Interac-tion of Ancient Architecture Based on the Integration of 3D Modeling and VR Technology-Taking Jiayuguan Fortress as an Example[J].Journal of Lanzhou University of Arts and Science(Natural Science Edition),2020,34(1):71-75.
[15]QU H.Using XGBoost to Identify Structures in Time Series[J].Journal of Jiujiang Vocational and Technical College,2019(3):80-81.
[16]TANG M Z,ZHAO Q,LONG W,et al.Fault Detection Based on Gradient Boosting Decision Tree for Wind Turbine Gearbox[J].Hunan Electric Power,2019,39(6):56-60,64.
[17]WANG Y,LI W,WU K H,et al.Application of Fusion Model of GBDT and LR in Encrypted Traffic Identification[J].Computer and Modernization,2020(3):93-98.
[18]FU F,JIANG J,SHAO Y,et al.An experimental evaluation of large scale GBDT systems[J].Proceedings of the VLDB Endowment,2019,12(11):1357-1370.
[19]LIU Y Q,LIU Z Y,ZHOU K,et al.Predicting Search UserExamination with Visual Saliency[J].ACM Sigir Forum,2016(6):619-628.
[20]CHU X F,ZHU C Y.Design and Implementation of 3D Virtual Roaming System[J].Mechanical and Electrical Information,2020(6):87-89.
[21]SANCHES C L,KISE K,AUGEREAU O.Japanese ReadingObjective Understanding Estimation by Eye Gaze Analysis[C]//UbiComp.ACM,2017:121-124.
[22]AGEEV M,LAGUN D,AGICHTEIN E.Improving search result summaries by using searcher behavior data[C]//Procee-dings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval.Association for Computing Machinery,New York,NY,USA,2013:13-22.
[23]FABRI M,MOORE D,HOBBS D.Mediating the Expression of Emotion in Educational Collaborative Virtual Environments:An Experimental Study[J].Virtual Reality,2004,7(2):66-81.
[24]LOPES P,ION A,BAUDISCH P.Impacto:Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation[C]//Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology.Association for Computing Machinery,New York,NY,USA,2015:11-19.
[25]DEY A,PIUMSOMBOON T,LEE Y,et al.Effects of Sharing Physiological States of Players in a Collaborative Virtual Reality Gameplay[C]//CHI Conference on Human Factors in Computing Systems.ACM,2017:4045-4056.

相关文章 15

[1]	曲倩文, 车啸平, 曲晨鑫, 李瑾如. 基于信息感知的虚拟现实用户临场感研究 Study on Information Perception Based User Presence in Virtual Reality 计算机科学, 2022, 49(9): 146-154. https://doi.org/10.11896/jsjkx.220500200
[2]	刘月红, 牛少华, 神显豪. 基于卷积神经网络的虚拟现实视频帧内预测编码 Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network 计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[3]	杨涵, 万游, 蔡洁萱, 方铭宇, 吴卓超, 金扬, 钱伟行. 基于步态分类辅助的虚拟IMU的行人导航方法 Pedestrian Navigation Method Based on Virtual Inertial Measurement Unit Assisted by GaitClassification 计算机科学, 2022, 49(6A): 759-763. https://doi.org/10.11896/jsjkx.211200148
[4]	李荪, 曹峰. 智能语音技术端到端框架模型分析和趋势研究 Analysis and Trend Research of End-to-End Framework Model of Intelligent Speech Technology 计算机科学, 2022, 49(6A): 331-336. https://doi.org/10.11896/jsjkx.210500180
[5]	张继凯, 李琦, 王月明, 吕晓琪. 基于单目RGB图像的三维手势跟踪算法综述 Survey of 3D Gesture Tracking Algorithms Based on Monocular RGB Images 计算机科学, 2022, 49(4): 174-187. https://doi.org/10.11896/jsjkx.210700084
[6]	刘亮, 蒲浩洋. 基于LSTM的多维度特征手势实时识别 Real-time LSTM-based Multi-dimensional Features Gesture Recognition 计算机科学, 2021, 48(8): 328-333. https://doi.org/10.11896/jsjkx.210300079
[7]	钱基德, 熊仁和, 王乾垒, 杜冬, 王在俊, 钱基业. 边缘计算在飞行训练中的应用 Application of Edge Computing in Flight Training 计算机科学, 2021, 48(6A): 603-607. https://doi.org/10.11896/jsjkx.201000035
[8]	马思琪, 车啸平, 于淇, 岳晨峰. 基于事件的虚拟现实用户体验评估方法研究 Event-based User Experience Evaluation Method for Virtual Reality Applications 计算机科学, 2021, 48(2): 167-174. https://doi.org/10.11896/jsjkx.200100065
[9]	张宇翔, 任爽. 定位技术在虚拟现实中的应用综述 Overview of Application of Positioning Technology in Virtual Reality 计算机科学, 2021, 48(1): 308-318. https://doi.org/10.11896/jsjkx.200800010
[10]	程时伟, 陈一健, 徐静如, 张柳新, 吴剑锋, 孙凌云. 一种基于脑电信号的眼动方向分类方法 Approach to Classification of Eye Movement Directions Based on EEG Signal 计算机科学, 2020, 47(4): 112-118. https://doi.org/10.11896/jsjkx.190200342
[11]	张政霖,张利伟,王文娟,夏莉,符豪,王宏志,杨立状,李海. 计算机化神经认知评估系统研究综述 Survey on Computerized Neurocognitive Assessment System 计算机科学, 2020, 47(2): 150-156. https://doi.org/10.11896/jsjkx.190100150
[12]	宁泽西, 秦绪佳, 陈佳舟. 基于三维场景的视频融合方法 Video Fusion Method Based on 3D Scene 计算机科学, 2020, 47(11A): 281-285. https://doi.org/10.11896/jsjkx.200400049
[13]	程时伟, 齐文杰. 基于动态轨迹的眼动跟踪隐式标定方法 Dynamic Trajectory Based Implicit Calibration Method for Eye Tracking 计算机科学, 2019, 46(8): 282-291. https://doi.org/10.11896/j.issn.1002-137X.2019.08.047
[14]	翟书颖, 李茹, 李波, 郝少阳. 视觉群智感知应用综述 Survey on Applications of Visual Crowdsensing 计算机科学, 2019, 46(6A): 11-15.
[15]	姬莉霞,刘成明. 基于虚拟现实技术的模糊静态图像目标重现方法 Fuzzy Static Image Target Reproduction Method Based on Virtual Reality Technology 计算机科学, 2018, 45(7): 248-251. https://doi.org/10.11896／j.issn.1002-137X.2018.07.043

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed