计算机科学 ›› 2016, Vol. 43 ›› Issue (9): 284-288.doi: 10.11896/j.issn.1002-137X.2016.09.057

• 图形图像与模式识别 • 上一篇    下一篇

基于Kinect体感交互的多人在线虚拟实验系统

孙博文,张佳梁,蔡亚飞,郭文兰   

  1. 哈尔滨理工大学计算机科学与技术学院 哈尔滨150080,哈尔滨理工大学计算机科学与技术学院 哈尔滨150080,哈尔滨理工大学计算机科学与技术学院 哈尔滨150080,哈尔滨理工大学计算机科学与技术学院 哈尔滨150080
  • 出版日期:2018-12-01 发布日期:2018-12-01

Multiplayer Online Virtual Experiment System Based on Kinect Somatosensory Interaction

SUN Bo-wen, ZHANG Jia-liang, CAI Ya-fei and GUO Wen-lan   

  • Online:2018-12-01 Published:2018-12-01

摘要: 为了满足多人异地进行真实感虚拟实验的需求,使用Kinect体感设备和Unity 3D引擎搭建了一个多人在线虚拟实验系统。在该系统中,使用Unity 3D引擎搭建虚拟实验场景,通过导入3D Max制作的实验器材模型进行实验搭建,并通过网络通信技术实现远距离多人在线操作。对于真实感部分,采用Kinect体感技术捕捉的身体姿势被用来控制虚拟场景中第一人称角色的走动、抓取和操作实验器材以及选取虚拟场景中的菜单。实验结果证明,Kinect姿势识别具有很高的准确性和鲁棒性,并且不容易被光照条件和复杂的背景所影响,服务器与客户端的通信对于建立远程虚拟实验系统来说足够稳定。该系统具有成本低、真实感较强的优点。

关键词: 多人在线,虚拟实验,Kinect,体感交互,Unity 3D

Abstract: In order to meet the needs of allowing more than one person conducting a certain virtual experiment at the same time in different places,we proposed a multiplayer online virtual experiment system built by Kinect somatosensory equipment and Unity 3D engine.In this system,the virtual experiment scenes are built by Unity 3D engine and experimental equipments are made by using 3D Max which is well-known as a modeling software.The multi-player online function is completed by the network communication technology.To make users feel real,the body gesture caught by Kinect somatosensory technology can be used to control first-person-character to walk around,grab experimental equipments and manipulate the menu in the virtual scene.The practical result shows that the Kinect gesture recognition has good accuracy and robustness,and is hardly affected by light situations and complex background.At the same time,the communication between the server and client is stable enough to build a remote virtual experiment system,and the system can achieve a high immersion with lower cost.

Key words: Multiplayer,Virtual experiment,Kinect,Somatosensory interaction,Unity 3D

[1] Lu Miao.The application of the virtual experiment in teaching researching[J].Chinese Journal of ICT in Education,2014,2:79-80(in Chinese) 卢苗.虚拟实验在教学中的应用限度研究[J].中国教育信息化,2014,2:79-80
[2] Brough J E,Schwartz M,Gupta S K.Towards the Development of a Virtual Environment-based Training System for Mechanical Assembly Operations[J].Virtual Reality,2007,1(4):189-206
[3] Garcia J,Valencia E S,Zalevsky Z,et al.Range Mapping using Speckle ecorrelation:US Pat 7,3,024 B2[P].2008-10-07
[4] Haggag H,Hossny M,Nahavandi S,et al.Real Time ErgonomicAssessment for Assembly Operations Using Kinect[C]∥International Conference on Computer Modeling and Simulation,2013.Hong Kong,2013:495-500
[5] Chen Y Y.Gesture Recognition based on Kinect and Application in the Virtual Assembly Technology[J].Electronic Design Engineering,2013,21(10):4-7
[6] Liao Hong-jian,Long Xiao-li.Study on Virtual Assembly Sys-tem Based on Kinect Somatosensory Interaction[C]∥ISCC.2013:55-60
[7] Liao Hong-jian,Qu Zhe.Virtual Experiment System for Electrician Training based on Kinect and Unity 3D[C]∥MEC.2013:2659-2662
[8] Shotton J,Fitzgibbon A.Real-Time Human Pose Recognition in Parts from Single Depth Images[DB/OL].http://www.microseft.com/en-us/research/people
[9] Lepetit V,Lagger P,Fua P.Randomized Trees for Real-time Key point Recognition[C]∥CVPR.2005:775-781
[10] Comaniciu D,Meer P.Mean shift:A robust approach toward feature space analysis[C]∥IEEE Trans.PAMI.2002:603-619
[11] 余涛.Kinect 应用开发实战,用最自然的方式与机器对话[M].北京:机械工业出版社,2012:141-145,296-300

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!