Computer Science

Computer Science ›› 2021, Vol. 48 ›› Issue (8): 315-321.doi: 10.11896/jsjkx.200500031

• Human-Machine Interaction • Previous Articles     Next Articles

Prediction and Assistance of Navigation Demand Based on Eye Tracking in Virtual Reality Environment

ZHU Chen-shuang, CHENG Shi-wei   

  1. School of Computer Science and Technology,Zhejiang University of Technology,Hangzhou 310023,China
  • Received:2020-05-08 Revised:2020-07-17 Published:2021-08-10
  • About author:ZHU Chen-shuang,born in 1995,postgraduate.Her main research interests include virtual reality and so on.
  • Supported by:
    National Natural Science Foundation of China(61772468).

PDF (PC)

583

Abstract: In order to solve the problems of insufficient user support and low user immersion in traditional navigation methods in complex virtual reality scenes, this paper proposes a binary classification model based on the gradient boost decision tree,which uses eye movement data before and after the user's need for auxiliary navigation in the VR environment to analyze and predict whether the user needs navigation during the task.The model is evaluated according to the user's gaze sequence,and the average precision and accuracy of the user demand judgment method are 77.6% and 77.2%,respectively.In addition,we implemente a navigation aid prototype system.By classifying the user's navigation requirement based on eye movement data,the user interface of the prototype system can automatically present the map for navigation.Experimental results showed that,compared with the traditional permanent assisted navigation method,the adaptive assisted navigation proposed in this paper can provide better user experience.

Key words: Eye tracking, Human computer interaction, Navigation, Virtual reality

CLC Number: 

  • TP391
[1]ALGHOFAILI R,SAWAHATA Y,HUANG H K,et al.Lost in Style:Gaze-driven Adaptive Aid for VR Navigation[C]//CHI Conference.Association for Computing Machinery,New York,NY,USA,2019:1-12.
[2]VLCEK K,LACZO J.Neural correlates of Spatial Navigationchanges in Mild Cognitive Impairment and Alzheimer's Disease[J].Front Behav Neurosci,2014(8):89.
[3]LAURA P,DE LUCA M,RAFFAELLA N,et al.Navigational Style Influences Eye Movement Pattern during Exploration and Learning of an Environmental Map[J].Frontiers in Behavioral Neuroscience,2016(10):e43620.
[4]KEVIN S,PAI Y S,KUNZE K.Virtual gaze:exploring use of gaze as rich interaction method with virtual agent in interactive virtual reality content[C]//Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology.ACM,2018:130.
[5]BOYD L A E,GUPTA S,VIKMANI S B,et al.vrSocial:To-ward Immersive Therapeutic VR Systems for Children with Autism[C]//The 2018 CHI Conference.Association for Computing Machinery.New York,NY,USA,2018:1-12.
[6]KASAHARA S,ANDO M,SUGANUMA K,et al.ParallelEyes:Exploring Human Capability and Behaviors with Paralleled First Person View Sharing[C]//CHI Conference on Human Factors in Computing Systems.Association for Computing Machinery,New York,NY,USA,2016:1-2.
[7]GANDRUD J,INTERRANTE V.Predicting destination using head orientation and gaze direction during locomotion in VR[C]//Proceedings of the ACM Symposium on Applied Perception.ACM,2016:31-38.
[8]LEE J,CHEON M,MOON S E,et al.Peripersonal Space in Vir-tual Reality:Navigating 3D Space with Different Perspectives[C]//Symposium on User Interface Software & Technology.Association for Computing Machinery,New York,NY,USA,2016:207-208.
[9]SAHA D P,KNAPP R B,MARTIN T L.Affective feedback in a virtual reality based intelligent supermarket[C]//Adjunct Acm Joint Conference on Pervasive & Ubiquitous Computing.ACM,2017:646-653.
[10]ZHOU J B.Study and Implementation on the Algorithm of Eye Tracking System[D].Xi'an:Xidian University,2010.
[11]WU Y Y.Research on the Technology of Eye Tracking[D].Xi'an:Xidian University,2009.
[12]MIAO L F.Geometry Modeling and Rendering of Point Set Surface[D].Hangzhou:Zhejiang University,2005.
[13]ZHU M,WAN L,ZHANG Y Y,et al.From 3D Model to Holographic Model:Application of Intelligent Model in Urban Planning-Taking the Urban Planning Assistant System of Chaohu City as an Example[J].Journal of Anhui Jianzhu University,2019,27(5):36-43.
[14]LIN G L,CAO Y J,BAO Y F.Research on Roaming and Interac-tion of Ancient Architecture Based on the Integration of 3D Modeling and VR Technology-Taking Jiayuguan Fortress as an Example[J].Journal of Lanzhou University of Arts and Science(Natural Science Edition),2020,34(1):71-75.
[15]QU H.Using XGBoost to Identify Structures in Time Series[J].Journal of Jiujiang Vocational and Technical College,2019(3):80-81.
[16]TANG M Z,ZHAO Q,LONG W,et al.Fault Detection Based on Gradient Boosting Decision Tree for Wind Turbine Gearbox[J].Hunan Electric Power,2019,39(6):56-60,64.
[17]WANG Y,LI W,WU K H,et al.Application of Fusion Model of GBDT and LR in Encrypted Traffic Identification[J].Computer and Modernization,2020(3):93-98.
[18]FU F,JIANG J,SHAO Y,et al.An experimental evaluation of large scale GBDT systems[J].Proceedings of the VLDB Endowment,2019,12(11):1357-1370.
[19]LIU Y Q,LIU Z Y,ZHOU K,et al.Predicting Search UserExamination with Visual Saliency[J].ACM Sigir Forum,2016(6):619-628.
[20]CHU X F,ZHU C Y.Design and Implementation of 3D Virtual Roaming System[J].Mechanical and Electrical Information,2020(6):87-89.
[21]SANCHES C L,KISE K,AUGEREAU O.Japanese ReadingObjective Understanding Estimation by Eye Gaze Analysis[C]//UbiComp.ACM,2017:121-124.
[22]AGEEV M,LAGUN D,AGICHTEIN E.Improving search result summaries by using searcher behavior data[C]//Procee-dings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval.Association for Computing Machinery,New York,NY,USA,2013:13-22.
[23]FABRI M,MOORE D,HOBBS D.Mediating the Expression of Emotion in Educational Collaborative Virtual Environments:An Experimental Study[J].Virtual Reality,2004,7(2):66-81.
[24]LOPES P,ION A,BAUDISCH P.Impacto:Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation[C]//Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology.Association for Computing Machinery,New York,NY,USA,2015:11-19.
[25]DEY A,PIUMSOMBOON T,LEE Y,et al.Effects of Sharing Physiological States of Players in a Collaborative Virtual Reality Gameplay[C]//CHI Conference on Human Factors in Computing Systems.ACM,2017:4045-4056.
[1] QU Qian-wen, CHE Xiao-ping, QU Chen-xin, LI Jin-ru. Study on Information Perception Based User Presence in Virtual Reality [J]. Computer Science, 2022, 49(9): 146-154.
[2] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
[3] YANG Han, WAN You, CAI Jie-xuan, FANG Ming-yu, WU Zhuo-chao, JIN Yang, QIAN Wei-xing. Pedestrian Navigation Method Based on Virtual Inertial Measurement Unit Assisted by GaitClassification [J]. Computer Science, 2022, 49(6A): 759-763.
[4] ZHANG Ji-kai, LI Qi, WANG Yue-ming, LYU Xiao-qi. Survey of 3D Gesture Tracking Algorithms Based on Monocular RGB Images [J]. Computer Science, 2022, 49(4): 174-187.
[5] WU Guang-zhi, GUO Bin, DING Ya-san, CHENG Jia-hui, YU Zhi-wen. Cognitive Mechanisms of Fake News [J]. Computer Science, 2021, 48(6): 306-314.
[6] MA Si-qi, CHE Xiao-ping, YU Qi, YUE Chen-feng. Event-based User Experience Evaluation Method for Virtual Reality Applications [J]. Computer Science, 2021, 48(2): 167-174.
[7] ZHANG Yu-xiang, REN Shuang. Overview of Application of Positioning Technology in Virtual Reality [J]. Computer Science, 2021, 48(1): 308-318.
[8] CHENG Shi-wei, CHEN Yi-jian, XU Jing-ru, ZHANG Liu-xin, WU Jian-feng, SUN Ling-yun. Approach to Classification of Eye Movement Directions Based on EEG Signal [J]. Computer Science, 2020, 47(4): 112-118.
[9] ZHANG Zheng-lin,ZHANG Li-wei,WANG Wen-juan,XIA Li,FU Hao,WANG Hong-zhi,YANG Li-zhuang and
LI Hai. Survey on Computerized Neurocognitive Assessment System [J]. Computer Science, 2020, 47(2): 150-156.
[10] CHEN Yu-tao, XU Wen-chao, ZHAO Zhao-na, LIU Hong-en, WANG Hao. Optimization of Scheduling and Maintenance Strategy for Navigation Aircraft Operation [J]. Computer Science, 2020, 47(11A): 632-637.
[11] CHENG Shi-wei, QI Wen-jie. Dynamic Trajectory Based Implicit Calibration Method for Eye Tracking [J]. Computer Science, 2019, 46(8): 282-291.
[12] ZHAI Shu-ying, LI Ru, LI Bo, HAO Shao-yang. Survey on Applications of Visual Crowdsensing [J]. Computer Science, 2019, 46(6A): 11-15.
[13] JI Li-xia, LIU Cheng-ming. Fuzzy Static Image Target Reproduction Method Based on Virtual Reality Technology [J]. Computer Science, 2018, 45(7): 248-251.
[14] CHEN Jin-yin, HU Ke-ke,LI Yu-wei. Research on UAV Multi-point Navigation Algorithm Based on MB-RRT* [J]. Computer Science, 2018, 45(6A): 85-90.
[15] CHENG Jing, ZHANG Tao, WANG Tao, DONG Zhan-wei. Graphic Complexity-based Prioritizing Technique for Regression Testing of Mobile Navigation Service [J]. Computer Science, 2018, 45(6): 141-144.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.