计算机科学 ›› 2021, Vol. 48 ›› Issue (1): 308-318.doi: 10.11896/jsjkx.200800010

• 交叉与前沿 • 上一篇    下一篇

定位技术在虚拟现实中的应用综述

张宇翔, 任爽   

  1. 北京交通大学计算机与信息技术学院 北京 100044
  • 收稿日期:2020-08-03 修回日期:2020-08-16 出版日期:2021-01-15 发布日期:2021-01-15
  • 通讯作者: 任爽(sren@bjtu.edu.cn)
  • 作者简介:19125290@bjtu.edu.cn
  • 基金资助:
    国家重点研发计划资助(2018YFB1201401);北京交通大学教育基金会基金资助(0207008402)

Overview of Application of Positioning Technology in Virtual Reality

ZHANG Yu-xiang, REN Shuang   

  1. School of Computer and Information Technology,Beijing Jiaotong University,Beijing 100044,China
  • Received:2020-08-03 Revised:2020-08-16 Online:2021-01-15 Published:2021-01-15
  • About author:ZHANG Yu-xiang,born in 1997,postgraduate.His main research interests include virtual reality and artificial intelligence.
    REN Shuang,born in 1981,Ph.D,associate professor,Ph.D supervisor,is a member of China Computer Federation.His main research interests include virtual reality and artificial intelligence.
  • Supported by:
    National Key R&D Program of China (2018YFB1201401) and Funds of Beijing Jiaotong University Education Foundation(0207008402).

摘要: 近年来,我国虚拟现实技术随着5G技术、传感器技术以及民用图形处理器的发展而快速发展,教育、交通、商业、娱乐、工业等领域对虚拟现实的需求与日俱增。虚拟现实技术是一门崭新的综合性信息技术,其中的定位技术是决定用户沉浸感和交互感的关键技术,是虚拟现实技术的重要依托。因此,需要着重对虚拟现实技术的定位技术进行总结。首先介绍了虚拟现实和定位技术;其次详细分析对比了目前虚拟现实系统中使用的典型定位技术,介绍了这些技术的原理、相关研究成果以及它们在虚拟现实中具体的运用场景;然后介绍了目前市场上主流的虚拟现实定位设备,继而讨论了虚拟现实定位技术使用的定位算法;最后介绍了虚拟现实定位技术目前存在的问题和今后的发展方向。

关键词: 定位技术, 定位算法, 计算机应用技术, 虚拟现实, 虚拟现实设备

Abstract: In recent years,virtual reality technology in our country has rapidly developed with the development of 5G technology,sensor technology and civilian graphics processors.The demand for virtual reality in education,transportation,commerce,entertainment,industry and other fields is increasing rapidly.Virtual reality technology is a brand-new comprehensive information technology,in which positioning technology is the key technology that determines user's immersion and interactionand is an important support for virtual reality technology.Therefore,it is necessary to focus on the summary of positioning technology,which is one of the core technologies of virtual reality.This paper first introduces virtual reality and positioning technology,then focuses on detailed analysis and comparison of typical positioning technologies currently used in virtual reality systems,and introduces the principles of these technologies,related research results,and their usage scenarios in virtual reality.After that,it introduces the mainstream virtual reality positioning equipment on the market,then discusses the positioning algorithms used in virtual reality positioning technology,and finally introduces current problems and future development directions of virtual reality positioning technology.

Key words: Computer application technology, Location algorithm, Positioning technology, Virtual reality, Virtual reality equipment

中图分类号: 

  • TP399
[1] ZHANG F J,DAI G Z,PENG X L.A review of human-computer interaction in virtual reality[J].Science in China:Information Science,2016,46(12):1711-1736.
[2] KHALAJMEHRABADI A,GATSIS N,AKOPIAND.ModernWLAN Fingerprinting Indoor Positioning Methods and Deployment Challenges[J].IEEE Communications Surveys & Tutorials,2017,19(3):1974-2002.
[3] DAI S.Design and implementation of indoor positioning system based on ultrasonic[D].Chengdu:Southwest Jiaotong University,2017.
[4] CHEN Y.Active visual positioning technology in immersive virtual reality[D].Chongqing:Chongqing University of Posts and Telecommunications,2017.
[5] WU J,LIU X J,PANG T,et al.Summary of the status quo of virtual reality and research on key technologies[J].Guangdong Communication Technology,2016,36(8):40-46.
[6] CASERMAN P,GARCIA-AGUNDEZA,KONRAD R,et al.Real-time body tracking in virtual reality using a Vive tracker[J].Virtual Reality,2019,23(2):155-168.
[7] NG A,CHAN L,LAU H.A low-cost lighthouse-based virtual reality head tracking system[C]//2017 International Conference on 3D Immersion (IC3D).Brussels:IEEE,2017:1-5.
[8] CHANG Y K,HUANG J W,CHEN C H,et al.A lightweight and efficient system for tracking handheld objects in virtual reality[C]//Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology Article.Tokyo:ACM,2018:1-2.
[9] XU W,WANG B,JIANG Y.Multi-target indoor tracking andrecognition system with infrared markers for virtual reality[C]//Electronic and Automation Control Conference (IAEAC).Chongqing:IEEE,2017:1549-1553.
[10] LIU X X,FENG X Y,PAN S J,et al.Skeleton Tracking Based on Kinect Camera and the Application in Virtual Reality System[C]//The 4th International Conference on Virtual Reality (ICVR 2018).Hong Kong,2018:21-25.
[11] WU N,WANG X D,HUQ Q,et al.High-precision indoor visible light positioning method based on multi-LED[J].Journal of Electronics & Information Technology,2015,37(3):727-732.
[12] TAN C T,LEONG T W,SHEN S,et al.Exploring Gameplay Experiences on the Oculus Rift[C]//Proceedings of the 2015 Symposium on Computer-Human Interaction in Play(CHI Play '15).2015:253-263.
[13] PATEL K,STUERZLINGER W.Simulation of a virtual reality tracking system[C]//2011 IEEE International Conference on Virtual Environments,Human-Computer Interfaces and Mea-surement Systems Proceedings.Ottawa,2011:1-6.
[14] WANG L N,ZHANG J L.Accurate Angle Positioning in VR Laser Virtual Control[J].Laser Journal,2018,39(5):133-137.
[15] WU W H,JIANG J,FAN X H,et al.Dual-machine pure angle passive positioning and performance analysis in WGS-84 coordinate system[J].Infrared and Laser Engineering,2015,44(2):654-661.
[16] ZHAO P,YANG M L,DING H,et al.Research on C-arm rotation angle positioning method based on IMU[J].Beijing Biome-dical Engineering,2016,35(2):167-174.
[17] ISLAM S,IONESCU B,GADEA C,et al.Full-body trackingusing a sensor array system and laser-based sweeps[C]//2016 IEEE Symposium on 3D User Interfaces (3DUI).Greenville,2016:71-80.
[18] SCHEER F,MÜLLER S.Large area indoor tracking for industrial augmented reality[C]//2010 IEEE International Sympo-sium on Mixed and Augmented Reality.Seoul:IEEE,2010:269-270.
[19] QUAN Y B,ZHU J.Research on indoor positioning based oninertial sensors and vision sensors[J].Journal of Dongguan University of Technology,2019,26(1):91-95,110.
[20] KIM J N,RYU M H,CHOI H R,et al.Development and Functional Evaluation of an Upper Extremity Rehabilitation System Based on Inertial Sensors and Virtual Reality[J].International Journal of Distributed Sensor Networks,2015,2013(2):945-948.
[21] JIAN B.Three-dimensional reconstruction of human body motion posture based on inertial sensors[D].Harbin:Harbin Engineering University,2013.
[22] DENG F P,HONG G,ZHANG S,et al.Research on motionsensing interaction technology based on HTC Vive[C]//4th International Conference on Machinery,Materials and Information Technology Applications (ICMMITA 2016).2016:101-104.
[23] SKRIPCAK T,TANUSKA P,SCHMEISSER N.Interactivecalibration and registration of electromagnetic tracking system for virtual reality[C]//International Doctoral Seminar.2011.
[24] NIE C M,YANG J W.Simulation of multi-degree-of-freedomelectromagnetic tracking method in virtual reality system[J].Computer Simulation,2019,36(4):330-333.
[25] YAN Z J.Research on indoor positioning application[J].Information and Communication,2016(6):223-224.
[26] LI C L,SU H S.Research on Ultrasonic Positioning System[J].Laboratory Research and Exploration,2013(2):39-44.
[27] YANG M H,LI L J,LI Z H.The application of ultrasonic three-dimensional space positioning in virtual reality system[J].Computer Simulation,2004(11):145-147,151.
[28] WEN Y,DONG K.Research on indoor robot positioning based on ultrasonic sensors[J].Information Technology,2015(8):54-56.
[29] NEWCOMBE R A,DAVISON A J.Live dense reconstruction with a single moving camera[C]//2010 Computer Vision and Pattern Recognition.San Francisco,2010:1498-1505.
[30] OBDRŽÁLEK S,KURILLO G,HAN J,et al.Real-time human pose detection and tracking for tele-rehabilitation in virtual rea-lity[J].Studies in Health Technology & Informatics,2012,173:320-324.
[31] LI C X,ZHANG J P,WU L Q.Design and Implementation of GIS Stereoscopic Display System supported by Virtual Reality Technology[J].Bulletin of Surveying and Mapping,2016(9):119-122.
[32] HUANG H Y.Design and implementation of an indoor virtual positioning and navigation system based on WIFI[D].Beijing:Beijing University of Chemical Technology,2016.
[33] WU Y,ZHANG J Z.Research on improved indoor WiFi positioning algorithm based on Android platform[J].Application of Electronic Technology,2017,43(3):77-79.
[34] WOODMAN O J,HARLE R K.Concurrent scheduling in theActive Bat location System[C]//IEEE International Conference on Pervasive Computing& Communications Workshops.IEEE Xplore,2010:431-437.
[35] NIC,NEWMAN.Apple iBeacon technology briefing[J].Journal of Direct,Data and Digital Marketing Practice,2014,15(3):222-225.
[36] ZHAO K.Research and implementation of indoor 3D navigation system based on Android platform[J].North China Land Resources,2016(4):115-117,123.
[37] ZHAO Y,LIU K,MA Y,et al.Similarity Analysis based Indoor Localization Algorithm with Backscatter Information of Passive UHF RFID Tags[J].IEEE Sensors Journal,2017,PP(99):1.
[38] LANDT J.The history of RFID[J].Potentials IEEE,2005,24(4):8-11.
[39] WANT R.An introduction to RFID technology[M].IEEE Educational Activities Department,2006:25-33.
[40] ZHENG Y,LI S K,HU C J,et al.Calculating positioning in distributed VR system[J].Computer Research and Development,1999(2):59-64.
[41] WANG Y Z.Research on the combination of target location and virtual reality in virtual geographic environment[D].Fuzhou:Fuzhou University,2013.
[42] LEE F W D I Y.position tracking add-on for mobile AR/VR[C]//SIGGRAPH '17 ACM SIGGRAPH 2017 Emerging Technologies.Los Angeles:ACM,2017:1-2.
[43] ZAYER M A,FOLMER E.StereoTrack:180-degree Low-cost Acoustic Positional Tracking for Mobile VR Platforms[C]//2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (CHI PLAY'18 Extended Abstracts).Melbourne:ACM,2018:143-154.
[44] FANG W,ZHENG L Y,DENG H J,et al.Real-Time Motion Tracking for Mobile Augmented/Virtual Reality Using Adaptive Visual-Inertial Fusion[J].Sensors,2017,17(5):1424-8220.
[45] CHIU P,TSENG P,FENG K.Interactive Mobile Augmented Reality System for Image and Hand Motion Tracking[C]//IEEE Transactions on Vehicular Technology.Melbourne,2018:9995-10009.
[46] BERRIEL R F,PAIXÃO T M,NICCHIO I,et al.Controlling First-Person Character Movement:A Low-Cost Camera-based Tracking Alternative for Virtual Reality[C]//2018 17th Brazi-lian Symposium on Computer Games and Digital Entertainment (SBGames).Foz do Iguaçu,2018:67-677.
[47] WU X Z,CHEN C C,LIU X F,et al.Cultural tourism virtual tour system integrated with IBeacon indoor positioning[J].Computer Engineering,2016,42(10):6-11.
[48] DUCHOWSKI A T,MEDLIN E,GRAMOPADHYE A,et al.Binocular eye tracking in VR for visual inspection training[C]//ACM Symposium on Virtual Reality Software and Technology(VRST'01).New York,2001:1-8.
[49] KÖLES M,HÁMORNIK B P,LÓGÓ E,et al.Tóvölgyi.Expe-riences of a combined psychophysiology and eye-tracking study in VR[C]//5th IEEE Conference on Cognitive Infocommunications (CogInfoCom).Vietri sul Mare,2014:391-395.
[50] DI STASI L L,CATENA ,ANDRÉ,et al.Saccadic velocity as an arousal index in naturalistic tasks[J].Neuroence & Biobehavioral Reviews,2013,37(5):968-975.
[51] PIQUADO T,ISAACOWITZ D,WINGFIELD A.Pupillometry as a measure of cognitive effort in younger and older adults[J].Psychophysiology,2010,47(3):560-569.
[52] IQBAL S T,ZHENG X S,BAILEYB P.Task-evoked pupillary response to mental workload in human-computer interaction[C]//Extended Abstracts on Human Factors in Computing Systems (CHI EA'04).Vienna,2004:1477-1480.
[53] LI B,ZHANG Y,ZHENG X,et al.A Smart Eye Tracking System for Virtual Reality[C]//2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC).Nanjing,2019:1-3.
[54] SUNDSTEDT V,NAVARRO D,MAUTNER J.Possibilitiesand challenges with eye tracking in video games and virtual rea-lity applications[C]//SIGGRAPH ASIA 2016 Courses (SA'16).Macau,2016:1-150.
[55] CLAY V,KÖNIG P,KOENIG S U.Eye Tracking in Virtual Rea-lity[J].Journal of Eye Movement Research,2019,12(1):1-3.
[56] LI X H,XIE C M,JIA Y Z,et al.Fast target detection algorithm based on ORB feature[J].Journal of Electronic Measurement and Instrument,2013,27(5):455-460.
[57] AVRUTOV V V,AKSONENKO P M,HENAFF P,et al.3D-calibration of the IMU[C]//2017 IEEE 37th International Conference on Electronics and Nanotechnology (ELNANO).Kiev,2017:374-379.
[58] HILMAN M,BASUKI D K,SUKARIDHOTO S.VirtualHand:VR Hand Controller Using IMU and Flex Sensor[C]//2018 International Electronics Symposium on Knowledge Creation and Intelligent Computing (IES-KCIC).Bali,2018:310-314.
[59] SANTOS P C,STORK A,BUAES A,et al.A real-time low-cost marker-based multiple camera tracking solution for virtual[J].Journal of Real-Time Image Processing,2010,5(2):121-128.
[60] ZHANG X,ZHAO Y,MITCHELL N,et al.A New 360 Camera Design for Multi Format VR Experiences[C]//2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).Osaka,2019:1273-1274.
[61] YOON Y J,NO J,CHOI S M.Saliency-Guided Stereo Camera Control for Comfortable VR Explorations[J].IEICE Transactions on Information and Systems.2017,100(9):2245-2248.
[62] YAN P C,LIU D,HU F.Analysis of network performance of ZigBee network in mine water inrush application[J].Journal of Henan University of Science and Technology (Natural Science Edition),2019,40(2):45-49.
[63] LIU Y Q,YIN Y D,ZHANG B,et al.A low-power radio frequency wireless transceiver chip baseband controller[J].Research and Progress in Solid State Electronics,2014,34(1):90-94.
[64] YUAN T Z.Design of RFID high frequency digital baseband controller based on SM4 algorithm[D].Wuhan:Huazhong University of Science and Technology,2017.
[65] SUN D Y,ZHANG R W,LI Z.Summary of indoor positioning technology[J].Unmanned System Technology,2020,3(3):32-46.
[66] LIU D H.Design and implementation of indoor positioning monitoring system based on virtual reality[D].Beijing:Beijing University of Posts and Telecommunications,2012.
[67] WANG C.Research and implementation of indoor positioningtechnology based on iBeacon location fingerprint[D].Chengdu:University of Electronic Science and Technology of China,2020.
[68] ZHU L,QIAN Z C.An improved WiFi positioning methodbased on logarithmic path loss model[J].Geographic Information for Surveying and Mapping,2019,44(2):69-70,92.
[69] QIU Z Y,WANG P,ZHU J,et al.NYFR output pulse radar signal TOA analysis using extended Fourier transform and its TOA estimation[J].Journal of Systems Engineering and Electronics,2017,28(2):212-223.
[70] GONG F X,WANG Q,ZHANG X G.GPS/TDOA Steepest Descent Hybrid Positioning Algorithm in Non-Line-of-sight Environment[J].Chinese Journal of Scientific Instrument,2011,32(7):1500-1506.
[71] WANG Y M.On the future development trend of VR moviesound reproduction system-Talking from the spatial positioning of movie sound[J].Modern Film Technology,2016(5):29-35.
[72] LI X X.Virtual Reality Special Report[R].China:Shanxi Securities,2019.
[73] China Business Industry Research Institute.Research Report on China's Virtual Reality Industry Market Status and Development Prospects[R].China:China Business Industry Research Institute,2018.
[74] KUAI J.VR/AR welcomes rapid development opportunities[R].China:Orient Securities,2020.
[75] ZUO W Q,QIAN D H,ZHAO W,et al.Research on laser positioning reflector matching based on ICP algorithm[J].Automation Instrumentation,2020,41(6):63-67.
[76] MA L Q.Research and application of indoor positioning and navigation system[D].Beijing:North China Electric Power University,2019.
[77] ZHANG Y L.Research and application of optical positioning in virtual reality[D].Henan:Henan University,2017.
[78] SUN D Y,ZHANG R W,LI Z.Summary of indoor positioning technology[J].Unmanned System Technology,2020,3(3):32-46.
[1] 曲倩文, 车啸平, 曲晨鑫, 李瑾如.
基于信息感知的虚拟现实用户临场感研究
Study on Information Perception Based User Presence in Virtual Reality
计算机科学, 2022, 49(9): 146-154. https://doi.org/10.11896/jsjkx.220500200
[2] 刘月红, 牛少华, 神显豪.
基于卷积神经网络的虚拟现实视频帧内预测编码
Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network
计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[3] 张继凯, 李琦, 王月明, 吕晓琪.
基于单目RGB图像的三维手势跟踪算法综述
Survey of 3D Gesture Tracking Algorithms Based on Monocular RGB Images
计算机科学, 2022, 49(4): 174-187. https://doi.org/10.11896/jsjkx.210700084
[4] 朱晨爽, 程时伟.
虚拟现实环境下基于眼动跟踪的导航需求预测与辅助
Prediction and Assistance of Navigation Demand Based on Eye Tracking in Virtual Reality Environment
计算机科学, 2021, 48(8): 315-321. https://doi.org/10.11896/jsjkx.200500031
[5] 马思琪, 车啸平, 于淇, 岳晨峰.
基于事件的虚拟现实用户体验评估方法研究
Event-based User Experience Evaluation Method for Virtual Reality Applications
计算机科学, 2021, 48(2): 167-174. https://doi.org/10.11896/jsjkx.200100065
[6] 张政霖,张利伟,王文娟,夏莉,符豪,王宏志,杨立状,李海.
计算机化神经认知评估系统研究综述
Survey on Computerized Neurocognitive Assessment System
计算机科学, 2020, 47(2): 150-156. https://doi.org/10.11896/jsjkx.190100150
[7] 宁泽西, 秦绪佳, 陈佳舟.
基于三维场景的视频融合方法
Video Fusion Method Based on 3D Scene
计算机科学, 2020, 47(11A): 281-285. https://doi.org/10.11896/jsjkx.200400049
[8] 姬莉霞,刘成明.
基于虚拟现实技术的模糊静态图像目标重现方法
Fuzzy Static Image Target Reproduction Method Based on Virtual Reality Technology
计算机科学, 2018, 45(7): 248-251. https://doi.org/10.11896/j.issn.1002-137X.2018.07.043
[9] 熊志利,瞿少成.
无线传感器网络节点的自定位技术研究
Self Localization Technology of Wireless Sensor Network Node
计算机科学, 2017, 44(Z6): 319-321. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.073
[10] 张宁, 刘迎春, 沈智鹏, 郭晨.
虚拟现实技术在专门用途英语教学中的应用研究综述
Review of Virtual Reality Technology Based Application Research in English Teaching for Special Purposes
计算机科学, 2017, 44(Z6): 43-47. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.009
[11] 崔鸿飞,刘佳,顾晶晶,庄毅.
基于局部保持典型相关分析的无线传感器网络三维定位算法
3D Localization Estimation Algorithm Based on Locality Preserving Canonical Correlation Analysis in Wireless Sensor Networks
计算机科学, 2017, 44(9): 105-109. https://doi.org/10.11896/j.issn.1002-137X.2017.09.021
[12] 潘仁宇,孙长乐,熊伟,王海涛.
虚拟装配环境中碰撞检测算法的研究综述与展望
Survey and Prospect of Collision Detection Based on Virtual Assembly Environment
计算机科学, 2016, 43(Z11): 136-139. https://doi.org/10.11896/j.issn.1002-137X.2016.11A.029
[13] 王万良,石浩,李燕君.
基于Mamdani型模糊推理的加权质心定位算法
Weighted Centroid Localization Algorithm Based on Mamdani Fuzzy Theory
计算机科学, 2015, 42(10): 101-105.
[14] 孟凡振,吴杰,卜旭松,冯锋.
基于马尔可夫链模型的井下目标轨迹预测算法
Underground Target Track Prediction Algorithm Based on Markov Chain Model
计算机科学, 2014, 41(Z6): 321-323.
[15] 黄地龙,邓飞,唐云.
虚拟现实技术在隧道开挖工程中的应用
Application of Virtual Reality Technique in Tunnel Excavation Engineering
计算机科学, 2013, 40(Z6): 377-380.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!