计算机科学 ›› 2021, Vol. 48 ›› Issue (1): 308-318.doi: 10.11896/jsjkx.200800010
张宇翔, 任爽
ZHANG Yu-xiang, REN Shuang
摘要: 近年来,我国虚拟现实技术随着5G技术、传感器技术以及民用图形处理器的发展而快速发展,教育、交通、商业、娱乐、工业等领域对虚拟现实的需求与日俱增。虚拟现实技术是一门崭新的综合性信息技术,其中的定位技术是决定用户沉浸感和交互感的关键技术,是虚拟现实技术的重要依托。因此,需要着重对虚拟现实技术的定位技术进行总结。首先介绍了虚拟现实和定位技术;其次详细分析对比了目前虚拟现实系统中使用的典型定位技术,介绍了这些技术的原理、相关研究成果以及它们在虚拟现实中具体的运用场景;然后介绍了目前市场上主流的虚拟现实定位设备,继而讨论了虚拟现实定位技术使用的定位算法;最后介绍了虚拟现实定位技术目前存在的问题和今后的发展方向。
中图分类号:
[1] ZHANG F J,DAI G Z,PENG X L.A review of human-computer interaction in virtual reality[J].Science in China:Information Science,2016,46(12):1711-1736. [2] KHALAJMEHRABADI A,GATSIS N,AKOPIAND.ModernWLAN Fingerprinting Indoor Positioning Methods and Deployment Challenges[J].IEEE Communications Surveys & Tutorials,2017,19(3):1974-2002. [3] DAI S.Design and implementation of indoor positioning system based on ultrasonic[D].Chengdu:Southwest Jiaotong University,2017. [4] CHEN Y.Active visual positioning technology in immersive virtual reality[D].Chongqing:Chongqing University of Posts and Telecommunications,2017. [5] WU J,LIU X J,PANG T,et al.Summary of the status quo of virtual reality and research on key technologies[J].Guangdong Communication Technology,2016,36(8):40-46. [6] CASERMAN P,GARCIA-AGUNDEZA,KONRAD R,et al.Real-time body tracking in virtual reality using a Vive tracker[J].Virtual Reality,2019,23(2):155-168. [7] NG A,CHAN L,LAU H.A low-cost lighthouse-based virtual reality head tracking system[C]//2017 International Conference on 3D Immersion (IC3D).Brussels:IEEE,2017:1-5. [8] CHANG Y K,HUANG J W,CHEN C H,et al.A lightweight and efficient system for tracking handheld objects in virtual reality[C]//Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology Article.Tokyo:ACM,2018:1-2. [9] XU W,WANG B,JIANG Y.Multi-target indoor tracking andrecognition system with infrared markers for virtual reality[C]//Electronic and Automation Control Conference (IAEAC).Chongqing:IEEE,2017:1549-1553. [10] LIU X X,FENG X Y,PAN S J,et al.Skeleton Tracking Based on Kinect Camera and the Application in Virtual Reality System[C]//The 4th International Conference on Virtual Reality (ICVR 2018).Hong Kong,2018:21-25. [11] WU N,WANG X D,HUQ Q,et al.High-precision indoor visible light positioning method based on multi-LED[J].Journal of Electronics & Information Technology,2015,37(3):727-732. [12] TAN C T,LEONG T W,SHEN S,et al.Exploring Gameplay Experiences on the Oculus Rift[C]//Proceedings of the 2015 Symposium on Computer-Human Interaction in Play(CHI Play '15).2015:253-263. [13] PATEL K,STUERZLINGER W.Simulation of a virtual reality tracking system[C]//2011 IEEE International Conference on Virtual Environments,Human-Computer Interfaces and Mea-surement Systems Proceedings.Ottawa,2011:1-6. [14] WANG L N,ZHANG J L.Accurate Angle Positioning in VR Laser Virtual Control[J].Laser Journal,2018,39(5):133-137. [15] WU W H,JIANG J,FAN X H,et al.Dual-machine pure angle passive positioning and performance analysis in WGS-84 coordinate system[J].Infrared and Laser Engineering,2015,44(2):654-661. [16] ZHAO P,YANG M L,DING H,et al.Research on C-arm rotation angle positioning method based on IMU[J].Beijing Biome-dical Engineering,2016,35(2):167-174. [17] ISLAM S,IONESCU B,GADEA C,et al.Full-body trackingusing a sensor array system and laser-based sweeps[C]//2016 IEEE Symposium on 3D User Interfaces (3DUI).Greenville,2016:71-80. [18] SCHEER F,MÜLLER S.Large area indoor tracking for industrial augmented reality[C]//2010 IEEE International Sympo-sium on Mixed and Augmented Reality.Seoul:IEEE,2010:269-270. [19] QUAN Y B,ZHU J.Research on indoor positioning based oninertial sensors and vision sensors[J].Journal of Dongguan University of Technology,2019,26(1):91-95,110. [20] KIM J N,RYU M H,CHOI H R,et al.Development and Functional Evaluation of an Upper Extremity Rehabilitation System Based on Inertial Sensors and Virtual Reality[J].International Journal of Distributed Sensor Networks,2015,2013(2):945-948. [21] JIAN B.Three-dimensional reconstruction of human body motion posture based on inertial sensors[D].Harbin:Harbin Engineering University,2013. [22] DENG F P,HONG G,ZHANG S,et al.Research on motionsensing interaction technology based on HTC Vive[C]//4th International Conference on Machinery,Materials and Information Technology Applications (ICMMITA 2016).2016:101-104. [23] SKRIPCAK T,TANUSKA P,SCHMEISSER N.Interactivecalibration and registration of electromagnetic tracking system for virtual reality[C]//International Doctoral Seminar.2011. [24] NIE C M,YANG J W.Simulation of multi-degree-of-freedomelectromagnetic tracking method in virtual reality system[J].Computer Simulation,2019,36(4):330-333. [25] YAN Z J.Research on indoor positioning application[J].Information and Communication,2016(6):223-224. [26] LI C L,SU H S.Research on Ultrasonic Positioning System[J].Laboratory Research and Exploration,2013(2):39-44. [27] YANG M H,LI L J,LI Z H.The application of ultrasonic three-dimensional space positioning in virtual reality system[J].Computer Simulation,2004(11):145-147,151. [28] WEN Y,DONG K.Research on indoor robot positioning based on ultrasonic sensors[J].Information Technology,2015(8):54-56. [29] NEWCOMBE R A,DAVISON A J.Live dense reconstruction with a single moving camera[C]//2010 Computer Vision and Pattern Recognition.San Francisco,2010:1498-1505. [30] OBDRÁLEK S,KURILLO G,HAN J,et al.Real-time human pose detection and tracking for tele-rehabilitation in virtual rea-lity[J].Studies in Health Technology & Informatics,2012,173:320-324. [31] LI C X,ZHANG J P,WU L Q.Design and Implementation of GIS Stereoscopic Display System supported by Virtual Reality Technology[J].Bulletin of Surveying and Mapping,2016(9):119-122. [32] HUANG H Y.Design and implementation of an indoor virtual positioning and navigation system based on WIFI[D].Beijing:Beijing University of Chemical Technology,2016. [33] WU Y,ZHANG J Z.Research on improved indoor WiFi positioning algorithm based on Android platform[J].Application of Electronic Technology,2017,43(3):77-79. [34] WOODMAN O J,HARLE R K.Concurrent scheduling in theActive Bat location System[C]//IEEE International Conference on Pervasive Computing& Communications Workshops.IEEE Xplore,2010:431-437. [35] NIC,NEWMAN.Apple iBeacon technology briefing[J].Journal of Direct,Data and Digital Marketing Practice,2014,15(3):222-225. [36] ZHAO K.Research and implementation of indoor 3D navigation system based on Android platform[J].North China Land Resources,2016(4):115-117,123. [37] ZHAO Y,LIU K,MA Y,et al.Similarity Analysis based Indoor Localization Algorithm with Backscatter Information of Passive UHF RFID Tags[J].IEEE Sensors Journal,2017,PP(99):1. [38] LANDT J.The history of RFID[J].Potentials IEEE,2005,24(4):8-11. [39] WANT R.An introduction to RFID technology[M].IEEE Educational Activities Department,2006:25-33. [40] ZHENG Y,LI S K,HU C J,et al.Calculating positioning in distributed VR system[J].Computer Research and Development,1999(2):59-64. [41] WANG Y Z.Research on the combination of target location and virtual reality in virtual geographic environment[D].Fuzhou:Fuzhou University,2013. [42] LEE F W D I Y.position tracking add-on for mobile AR/VR[C]//SIGGRAPH '17 ACM SIGGRAPH 2017 Emerging Technologies.Los Angeles:ACM,2017:1-2. [43] ZAYER M A,FOLMER E.StereoTrack:180-degree Low-cost Acoustic Positional Tracking for Mobile VR Platforms[C]//2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (CHI PLAY'18 Extended Abstracts).Melbourne:ACM,2018:143-154. [44] FANG W,ZHENG L Y,DENG H J,et al.Real-Time Motion Tracking for Mobile Augmented/Virtual Reality Using Adaptive Visual-Inertial Fusion[J].Sensors,2017,17(5):1424-8220. [45] CHIU P,TSENG P,FENG K.Interactive Mobile Augmented Reality System for Image and Hand Motion Tracking[C]//IEEE Transactions on Vehicular Technology.Melbourne,2018:9995-10009. [46] BERRIEL R F,PAIXÃO T M,NICCHIO I,et al.Controlling First-Person Character Movement:A Low-Cost Camera-based Tracking Alternative for Virtual Reality[C]//2018 17th Brazi-lian Symposium on Computer Games and Digital Entertainment (SBGames).Foz do Iguaçu,2018:67-677. [47] WU X Z,CHEN C C,LIU X F,et al.Cultural tourism virtual tour system integrated with IBeacon indoor positioning[J].Computer Engineering,2016,42(10):6-11. [48] DUCHOWSKI A T,MEDLIN E,GRAMOPADHYE A,et al.Binocular eye tracking in VR for visual inspection training[C]//ACM Symposium on Virtual Reality Software and Technology(VRST'01).New York,2001:1-8. [49] KÖLES M,HÁMORNIK B P,LÓGÓ E,et al.Tóvölgyi.Expe-riences of a combined psychophysiology and eye-tracking study in VR[C]//5th IEEE Conference on Cognitive Infocommunications (CogInfoCom).Vietri sul Mare,2014:391-395. [50] DI STASI L L,CATENA ,ANDRÉ,et al.Saccadic velocity as an arousal index in naturalistic tasks[J].Neuroence & Biobehavioral Reviews,2013,37(5):968-975. [51] PIQUADO T,ISAACOWITZ D,WINGFIELD A.Pupillometry as a measure of cognitive effort in younger and older adults[J].Psychophysiology,2010,47(3):560-569. [52] IQBAL S T,ZHENG X S,BAILEYB P.Task-evoked pupillary response to mental workload in human-computer interaction[C]//Extended Abstracts on Human Factors in Computing Systems (CHI EA'04).Vienna,2004:1477-1480. [53] LI B,ZHANG Y,ZHENG X,et al.A Smart Eye Tracking System for Virtual Reality[C]//2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC).Nanjing,2019:1-3. [54] SUNDSTEDT V,NAVARRO D,MAUTNER J.Possibilitiesand challenges with eye tracking in video games and virtual rea-lity applications[C]//SIGGRAPH ASIA 2016 Courses (SA'16).Macau,2016:1-150. [55] CLAY V,KÖNIG P,KOENIG S U.Eye Tracking in Virtual Rea-lity[J].Journal of Eye Movement Research,2019,12(1):1-3. [56] LI X H,XIE C M,JIA Y Z,et al.Fast target detection algorithm based on ORB feature[J].Journal of Electronic Measurement and Instrument,2013,27(5):455-460. [57] AVRUTOV V V,AKSONENKO P M,HENAFF P,et al.3D-calibration of the IMU[C]//2017 IEEE 37th International Conference on Electronics and Nanotechnology (ELNANO).Kiev,2017:374-379. [58] HILMAN M,BASUKI D K,SUKARIDHOTO S.VirtualHand:VR Hand Controller Using IMU and Flex Sensor[C]//2018 International Electronics Symposium on Knowledge Creation and Intelligent Computing (IES-KCIC).Bali,2018:310-314. [59] SANTOS P C,STORK A,BUAES A,et al.A real-time low-cost marker-based multiple camera tracking solution for virtual[J].Journal of Real-Time Image Processing,2010,5(2):121-128. [60] ZHANG X,ZHAO Y,MITCHELL N,et al.A New 360 Camera Design for Multi Format VR Experiences[C]//2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).Osaka,2019:1273-1274. [61] YOON Y J,NO J,CHOI S M.Saliency-Guided Stereo Camera Control for Comfortable VR Explorations[J].IEICE Transactions on Information and Systems.2017,100(9):2245-2248. [62] YAN P C,LIU D,HU F.Analysis of network performance of ZigBee network in mine water inrush application[J].Journal of Henan University of Science and Technology (Natural Science Edition),2019,40(2):45-49. [63] LIU Y Q,YIN Y D,ZHANG B,et al.A low-power radio frequency wireless transceiver chip baseband controller[J].Research and Progress in Solid State Electronics,2014,34(1):90-94. [64] YUAN T Z.Design of RFID high frequency digital baseband controller based on SM4 algorithm[D].Wuhan:Huazhong University of Science and Technology,2017. [65] SUN D Y,ZHANG R W,LI Z.Summary of indoor positioning technology[J].Unmanned System Technology,2020,3(3):32-46. [66] LIU D H.Design and implementation of indoor positioning monitoring system based on virtual reality[D].Beijing:Beijing University of Posts and Telecommunications,2012. [67] WANG C.Research and implementation of indoor positioningtechnology based on iBeacon location fingerprint[D].Chengdu:University of Electronic Science and Technology of China,2020. [68] ZHU L,QIAN Z C.An improved WiFi positioning methodbased on logarithmic path loss model[J].Geographic Information for Surveying and Mapping,2019,44(2):69-70,92. [69] QIU Z Y,WANG P,ZHU J,et al.NYFR output pulse radar signal TOA analysis using extended Fourier transform and its TOA estimation[J].Journal of Systems Engineering and Electronics,2017,28(2):212-223. [70] GONG F X,WANG Q,ZHANG X G.GPS/TDOA Steepest Descent Hybrid Positioning Algorithm in Non-Line-of-sight Environment[J].Chinese Journal of Scientific Instrument,2011,32(7):1500-1506. [71] WANG Y M.On the future development trend of VR moviesound reproduction system-Talking from the spatial positioning of movie sound[J].Modern Film Technology,2016(5):29-35. [72] LI X X.Virtual Reality Special Report[R].China:Shanxi Securities,2019. [73] China Business Industry Research Institute.Research Report on China's Virtual Reality Industry Market Status and Development Prospects[R].China:China Business Industry Research Institute,2018. [74] KUAI J.VR/AR welcomes rapid development opportunities[R].China:Orient Securities,2020. [75] ZUO W Q,QIAN D H,ZHAO W,et al.Research on laser positioning reflector matching based on ICP algorithm[J].Automation Instrumentation,2020,41(6):63-67. [76] MA L Q.Research and application of indoor positioning and navigation system[D].Beijing:North China Electric Power University,2019. [77] ZHANG Y L.Research and application of optical positioning in virtual reality[D].Henan:Henan University,2017. [78] SUN D Y,ZHANG R W,LI Z.Summary of indoor positioning technology[J].Unmanned System Technology,2020,3(3):32-46. |
[1] | 曲倩文, 车啸平, 曲晨鑫, 李瑾如. 基于信息感知的虚拟现实用户临场感研究 Study on Information Perception Based User Presence in Virtual Reality 计算机科学, 2022, 49(9): 146-154. https://doi.org/10.11896/jsjkx.220500200 |
[2] | 刘月红, 牛少华, 神显豪. 基于卷积神经网络的虚拟现实视频帧内预测编码 Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network 计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179 |
[3] | 张继凯, 李琦, 王月明, 吕晓琪. 基于单目RGB图像的三维手势跟踪算法综述 Survey of 3D Gesture Tracking Algorithms Based on Monocular RGB Images 计算机科学, 2022, 49(4): 174-187. https://doi.org/10.11896/jsjkx.210700084 |
[4] | 朱晨爽, 程时伟. 虚拟现实环境下基于眼动跟踪的导航需求预测与辅助 Prediction and Assistance of Navigation Demand Based on Eye Tracking in Virtual Reality Environment 计算机科学, 2021, 48(8): 315-321. https://doi.org/10.11896/jsjkx.200500031 |
[5] | 马思琪, 车啸平, 于淇, 岳晨峰. 基于事件的虚拟现实用户体验评估方法研究 Event-based User Experience Evaluation Method for Virtual Reality Applications 计算机科学, 2021, 48(2): 167-174. https://doi.org/10.11896/jsjkx.200100065 |
[6] | 张政霖,张利伟,王文娟,夏莉,符豪,王宏志,杨立状,李海. 计算机化神经认知评估系统研究综述 Survey on Computerized Neurocognitive Assessment System 计算机科学, 2020, 47(2): 150-156. https://doi.org/10.11896/jsjkx.190100150 |
[7] | 宁泽西, 秦绪佳, 陈佳舟. 基于三维场景的视频融合方法 Video Fusion Method Based on 3D Scene 计算机科学, 2020, 47(11A): 281-285. https://doi.org/10.11896/jsjkx.200400049 |
[8] | 姬莉霞,刘成明. 基于虚拟现实技术的模糊静态图像目标重现方法 Fuzzy Static Image Target Reproduction Method Based on Virtual Reality Technology 计算机科学, 2018, 45(7): 248-251. https://doi.org/10.11896/j.issn.1002-137X.2018.07.043 |
[9] | 熊志利,瞿少成. 无线传感器网络节点的自定位技术研究 Self Localization Technology of Wireless Sensor Network Node 计算机科学, 2017, 44(Z6): 319-321. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.073 |
[10] | 张宁, 刘迎春, 沈智鹏, 郭晨. 虚拟现实技术在专门用途英语教学中的应用研究综述 Review of Virtual Reality Technology Based Application Research in English Teaching for Special Purposes 计算机科学, 2017, 44(Z6): 43-47. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.009 |
[11] | 崔鸿飞,刘佳,顾晶晶,庄毅. 基于局部保持典型相关分析的无线传感器网络三维定位算法 3D Localization Estimation Algorithm Based on Locality Preserving Canonical Correlation Analysis in Wireless Sensor Networks 计算机科学, 2017, 44(9): 105-109. https://doi.org/10.11896/j.issn.1002-137X.2017.09.021 |
[12] | 潘仁宇,孙长乐,熊伟,王海涛. 虚拟装配环境中碰撞检测算法的研究综述与展望 Survey and Prospect of Collision Detection Based on Virtual Assembly Environment 计算机科学, 2016, 43(Z11): 136-139. https://doi.org/10.11896/j.issn.1002-137X.2016.11A.029 |
[13] | 王万良,石浩,李燕君. 基于Mamdani型模糊推理的加权质心定位算法 Weighted Centroid Localization Algorithm Based on Mamdani Fuzzy Theory 计算机科学, 2015, 42(10): 101-105. |
[14] | 孟凡振,吴杰,卜旭松,冯锋. 基于马尔可夫链模型的井下目标轨迹预测算法 Underground Target Track Prediction Algorithm Based on Markov Chain Model 计算机科学, 2014, 41(Z6): 321-323. |
[15] | 黄地龙,邓飞,唐云. 虚拟现实技术在隧道开挖工程中的应用 Application of Virtual Reality Technique in Tunnel Excavation Engineering 计算机科学, 2013, 40(Z6): 377-380. |
|