计算机科学 ›› 2022, Vol. 49 ›› Issue (9): 146-154.doi: 10.11896/jsjkx.220500200

• 计算机图形学&多媒体 • 上一篇    下一篇

基于信息感知的虚拟现实用户临场感研究

曲倩文, 车啸平, 曲晨鑫, 李瑾如   

  1. 北京交通大学软件学院 北京 100044
  • 收稿日期:2022-05-22 修回日期:2022-06-20 出版日期:2022-09-15 发布日期:2022-09-09
  • 通讯作者: 车啸平(xpche@bjtu.edu.cn)
  • 作者简介:(20126325@bjtu.edu.cn)
  • 基金资助:
    中央高校基本科研业务费专项资金(2021JBM028)

Study on Information Perception Based User Presence in Virtual Reality

QU Qian-wen, CHE Xiao-ping, QU Chen-xin, LI Jin-ru   

  1. School of Software Engineering,Beijing Jiaotong University,Beijing 100044,China
  • Received:2022-05-22 Revised:2022-06-20 Online:2022-09-15 Published:2022-09-09
  • About author:QU Qian-wen,born in 1998,master.Her main research interests include virtual reality and software engineering.
    CHE Xiao-ping,born in 1986,Ph.D,associate professor,is a member of China Computer Federation.His main research interests include ubiquitous computing,virtual reality and human computer interaction.
  • Supported by:
    Fundamental Research Funds for the Central Universities(2021JBM028).

摘要: 虚拟现实(Virtual Reality,VR)技术通过计算机构建仿真环境,为用户提供三维动态视图,增强用户的感官体验,使用户获得身临其境的沉浸感。随着虚拟现实技术的兴起和不断发展,人们在 VR 中的视觉和听觉体验有了很大的进步。随着多媒体技术的发展,全景视频逐渐出现。与普通视频相比,全景视频具有更宽的视角和更丰富的视觉信息。虚拟现实技术的广泛应用和全景视频技术的发展,使虚拟现实全景视频(VR Video)成为最受欢迎和关注的虚拟现实服务之一。用户在虚拟现实环境中的信息感知和接受行为也受到了影响。研究基于SMOTE算法、贝叶斯网络与逻辑回归等统计分析方法和Few-shot Learning算法,通过对比用户分别使用 VR 头戴式显示器和普通显示器 iPad 观看全景视频时的信息记忆程度、真实感、参与感等方面的差异,来探究用户在虚拟现实环境下的信息接受效果及临场感与传统媒介环境下的差异。实验结果表明,虚拟现实环境下的用户信息接受效果是传统媒介下的 1.24 倍,且虚拟现实环境下用户对于非正面信息和局部信息的接受效果分别是传统媒介下的 1.626倍 和1.245 倍,同时表明,用户的视觉停留时间长度对信息接受效果有正向影响。另外,在证实临场感可以被细分为真实感和参与感后,当临场感强时,视频A-视频D的平均信息记忆数目为9.20,9.13,8.83,10.57,而临场感弱时,其平均信息记忆数目为8.53,6.80,7.14,7.66,证明了用户信息感知时的临场感有利于使用户获得更好的信息接受效果。

关键词: 虚拟现实, 全景视频, 信息感知, 临场感, 用户体验

Abstract: Virtual Reality(VR) technology builds a simulation environment through a computer,provides users with a three-dimensional dynamic view,and enhances the user's sensory experience,so that the user will get an immersive sense of immersion.With the rise and continuous development of virtual reality technology,people's visual and auditory experience has made great progress.With the development of multimedia technology,panoramic video emerges gradually.Compared with ordinary video,panoramic video has a wider viewing angle and richer visual information.The wide application of virtual reality technology and the development of panoramic video technology make virtual reality panoramic video(VR Video) become one of the most popular and concerned VR services.The information perception and acceptance behavior of users in the virtual reality environment have also been affected.Based on SMOTE algorithm,Bayesian network,logistic regression,and other statistical analysis methods and Few-shot Learning algorithm,this paper compares the differences in users' information memory degree,sense of reality,sense of participation,and other aspects when using VR head-mounted display and ordinary display iPad to watch panoramic video respectively.To explore the difference between the user's information acceptance effect and the sense of presence in the virtual reality environment and the traditional media environment.Experiments show that users with virtual reality headsets score an average of about 0.786 for message acceptance,compared with 0.634 for iPad users with regular displays.Among them,the score of positive information and non-positive information receiving effect in the virtual reality environment is 1.626 times and 1.245 times that of in the traditional environment respectively.However,it is noteworthy that in video A,which has the longest average scene duration,there is no significant difference in the information acceptance effect.In addition,the length of the user's visual residence time has a positive impact on the acceptance effect of information.After verifying that the sense of presence can be subdivided into the sense of reality and sense of participation,this paper shows that the score of users for the sense of presence in the iPad environment is always lower than that of in a VR environment through feature engineering and classification decision tree.After that,the correlation coefficient of the least square method is used to prove that presence has a positive effect on user information acceptance.Meanwhile,with the help of the Few-shot Learning algorithm,the average information memory number of video A-D is 9.20,9.13,8.83,and 10.57 when the sense of presence is strong,while the average information memory number of video A-D is 8.53,6.80,7.14 and 7.66 when the sense of presence is weak.It is proved that the user's sense of presence during information perception is beneficial to the user to obtain a better information acceptance effect.

Key words: Virtual reality, Panoramic video, Information perception, Presence, User experience

中图分类号: 

  • TP391
[1]TORBEN V,DANIEL W,THOMAS F,et al.Testing the Social Presence Aspect of the Multimodal Presence Scale in a Virtual Reality Game[C]//Proceedings of Mensch und Computer.Association for Computing Machinery,2019:433-437.
[2]BETHANY A M,PAUL A B,MANUEL G.The Effect of Virtual Reality Control of a Robotic Surrogate on Presence and Social Presence in Comparison to Telecommunications Software[C]//Companion of the 2020 ACM/IEEE International Confe-rence on Human-Robot Interaction.Association for Computing Machinery.2020:349-351.
[3]MACQUARRIE A,STEED A.Cinematic virtual reality:Evalua-ting the effect of display type on the viewing experience for panoramic video[C]//IEEE Virtual Reality(VR).IEEE,2017:45-54.
[4]HARRISON J S,MICHAEL N.Communication Behavior inEmbodied Virtual Reality[C]//Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems.Association for Computing Machinery,2018:1-12.
[5]GUIMARĀES M,PRADA R,SANTOS P A,et al.The Impact of Virtual Reality in the Social Presence of a Virtual Agent[C]//Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents.Association for Computing Machi-nery,2020:1-8.
[6]KANGSOO K,RYAN S,JASON H,et al.Blowing in the wind:Increasing social presence with a virtual human via environmental airflow interaction in mixed reality[J].Computers & Gra-phics,2019,83:23-32.
[7]ROONEY B,BURKE C,BÁLINT K,et al.Virtual reality,pre-sence and social cognition:The effect of eye-gaze and narrativity on character engagement[C]//2017 23rd International Confe-rence on Virtual System & Multimedia(VSMM).IEEE,2017:1-6.
[8]RICHES S,ELGHANY S,GARETY P,et al.Factors Affecting Sense of Presence in a Virtual Reality Social Environment:A Qualitative Study[J].Cyberpsychology,Behavior and Social Networking,2019,22(4):288-292.
[9]PENGNATE S,RIGGINS F,ZHANG L.The Effects of Social and Spatial Presence on Engagement in a 3D Virtual Reality Environment:An Empirical Investigation[C]//Proceedings of the 52nd Hawaii International Conference on System Sciences.2019.
[10]WIENRICH C,SCHINDLER K,DÖLLINQER N,et al.Social presence and cooperation in large-scale multi-user virtualrea-lity-the relevance of social interdependence for location-based environments[C]//2018 IEEE Conference on Virtual Reality and 3D User Interfaces.IEEE,2018:207-214.
[11]TUSSYADIAH I P,WANG D,JUNG T H,et al.Virtual Rea-lity,Presence,and Attitude Change:Empirical Evidence from Tourism[J].Tourism Management,2018,66:140-154.
[12]WANG D,WANG X W,LI Y Q,et al.Research on user information receiving behavior telepresence in virtual reality environment [J].Modern Intelligence,2020,40(2):52-61.
[13]WITMER B G,SINGER M J.Measuring presence in virtual environments:A presence questionnaire[J].Presence,1998,7(3):225-240.
[14]YOUNGBLUT C.Experience of presence in virtual environ-ments[R].Institute for Defense Analyses Alexandria VA,2003.
[15]SHIN D H.Do Users Experience Real Sociability Through Social TV? Analyzing Parasocial Behavior in Relation to Social TV [J].Journal of Broadcasting & Electronic Media,2016,60(1):140-159.
[16]GREEN M C,BROCK T C.In the mind's eye:Transportation-imagery model of narrative persuasion[M/OL].2002.https://www.researchgate.net/publication/232511989_In_the_mind's_eye_Transportation-imagery_model_of_narrative_persuasion.
[17]SUN T,WU H F,LIANG Z G,et al.The application of SMOTE algorithm in imbalance data [J].Beijing Biomedical Enginee-ring,2012,31(5):528-530.
[18]WANG H Y,FAN H K,YAO Z G.SMOTE and Biased-SVM combined imbalance data classification method [J].Computer Science,2008,4(5):174-176.
[19]ZHAO K L,JIN X L,WANG Y Z.A review of research onsmall sample learning [J].Journal of Software,2021,32(2):349-369.
[20]LI F C,LIU Y,WU P X,et al.A review of meta-learning research [J].Journal of Computers,2021,44(2):422-446.
[1] 刘月红, 牛少华, 神显豪.
基于卷积神经网络的虚拟现实视频帧内预测编码
Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network
计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[2] 杨桃雨, 徐媛媛, 谭增洁.
面向6G的全景视频片划分优化编码算法
Tile Partition Optimized Omnidirectional Video Coding for 6G Network
计算机科学, 2022, 49(6): 66-72. https://doi.org/10.11896/jsjkx.220400034
[3] 张继凯, 李琦, 王月明, 吕晓琪.
基于单目RGB图像的三维手势跟踪算法综述
Survey of 3D Gesture Tracking Algorithms Based on Monocular RGB Images
计算机科学, 2022, 49(4): 174-187. https://doi.org/10.11896/jsjkx.210700084
[4] 朱晨爽, 程时伟.
虚拟现实环境下基于眼动跟踪的导航需求预测与辅助
Prediction and Assistance of Navigation Demand Based on Eye Tracking in Virtual Reality Environment
计算机科学, 2021, 48(8): 315-321. https://doi.org/10.11896/jsjkx.200500031
[5] 马思琪, 车啸平, 于淇, 岳晨峰.
基于事件的虚拟现实用户体验评估方法研究
Event-based User Experience Evaluation Method for Virtual Reality Applications
计算机科学, 2021, 48(2): 167-174. https://doi.org/10.11896/jsjkx.200100065
[6] 张宇翔, 任爽.
定位技术在虚拟现实中的应用综述
Overview of Application of Positioning Technology in Virtual Reality
计算机科学, 2021, 48(1): 308-318. https://doi.org/10.11896/jsjkx.200800010
[7] 张政霖,张利伟,王文娟,夏莉,符豪,王宏志,杨立状,李海.
计算机化神经认知评估系统研究综述
Survey on Computerized Neurocognitive Assessment System
计算机科学, 2020, 47(2): 150-156. https://doi.org/10.11896/jsjkx.190100150
[8] 宁泽西, 秦绪佳, 陈佳舟.
基于三维场景的视频融合方法
Video Fusion Method Based on 3D Scene
计算机科学, 2020, 47(11A): 281-285. https://doi.org/10.11896/jsjkx.200400049
[9] 李孟君, 黎文伟.
基于视觉特性的手机屏幕亮度自适应调节算法
Adaptive Adjustment Algorithm of Mobile Phone Screen Brightness Based on Visual Characteristics
计算机科学, 2019, 46(2): 255-260. https://doi.org/10.11896/j.issn.1002-137X.2019.02.039
[10] 姬莉霞,刘成明.
基于虚拟现实技术的模糊静态图像目标重现方法
Fuzzy Static Image Target Reproduction Method Based on Virtual Reality Technology
计算机科学, 2018, 45(7): 248-251. https://doi.org/10.11896/j.issn.1002-137X.2018.07.043
[11] 韩立, 刘正捷.
CAUXT:帮助研究人员在感兴趣的情境中采集用户体验数据
CAUXT:A Tool to Help User Experience Researchers Capture Users’ Experience Data in Context of Interest
计算机科学, 2018, 45(7): 278-285. https://doi.org/10.11896/j.issn.1002-137X.2018.07.048
[12] 张宁, 刘迎春, 沈智鹏, 郭晨.
虚拟现实技术在专门用途英语教学中的应用研究综述
Review of Virtual Reality Technology Based Application Research in English Teaching for Special Purposes
计算机科学, 2017, 44(Z6): 43-47. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.009
[13] 王伟,胡长武,郭栋,张静轩,常进达,张礼庆.
一种面向云构软件的云操作系统
Cloud Operating System for Cloudware
计算机科学, 2017, 44(11): 33-40. https://doi.org/10.11896/j.issn.1002-137X.2017.11.006
[14] 潘仁宇,孙长乐,熊伟,王海涛.
虚拟装配环境中碰撞检测算法的研究综述与展望
Survey and Prospect of Collision Detection Based on Virtual Assembly Environment
计算机科学, 2016, 43(Z11): 136-139. https://doi.org/10.11896/j.issn.1002-137X.2016.11A.029
[15] 陈希宏,金跃辉,杨 谈.
3G网络中移动视频质量评估模型的研究
Study on Quality Assessment Model for Mobile Videos over 3G Network
计算机科学, 2015, 42(9): 86-93. https://doi.org/10.11896/j.issn.1002-137X.2015.09.018
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!