Computer Science ›› 2016, Vol. 43 ›› Issue (9): 284-288.doi: 10.11896/j.issn.1002-137X.2016.09.057

Previous Articles     Next Articles

Multiplayer Online Virtual Experiment System Based on Kinect Somatosensory Interaction

SUN Bo-wen, ZHANG Jia-liang, CAI Ya-fei and GUO Wen-lan   

  • Online:2018-12-01 Published:2018-12-01

Abstract: In order to meet the needs of allowing more than one person conducting a certain virtual experiment at the same time in different places,we proposed a multiplayer online virtual experiment system built by Kinect somatosensory equipment and Unity 3D engine.In this system,the virtual experiment scenes are built by Unity 3D engine and experimental equipments are made by using 3D Max which is well-known as a modeling software.The multi-player online function is completed by the network communication technology.To make users feel real,the body gesture caught by Kinect somatosensory technology can be used to control first-person-character to walk around,grab experimental equipments and manipulate the menu in the virtual scene.The practical result shows that the Kinect gesture recognition has good accuracy and robustness,and is hardly affected by light situations and complex background.At the same time,the communication between the server and client is stable enough to build a remote virtual experiment system,and the system can achieve a high immersion with lower cost.

Key words: Multiplayer,Virtual experiment,Kinect,Somatosensory interaction,Unity 3D

[1] Lu Miao.The application of the virtual experiment in teaching researching[J].Chinese Journal of ICT in Education,2014,2:79-80(in Chinese) 卢苗.虚拟实验在教学中的应用限度研究[J].中国教育信息化,2014,2:79-80
[2] Brough J E,Schwartz M,Gupta S K.Towards the Development of a Virtual Environment-based Training System for Mechanical Assembly Operations[J].Virtual Reality,2007,1(4):189-206
[3] Garcia J,Valencia E S,Zalevsky Z,et al.Range Mapping using Speckle ecorrelation:US Pat 7,3,024 B2[P].2008-10-07
[4] Haggag H,Hossny M,Nahavandi S,et al.Real Time ErgonomicAssessment for Assembly Operations Using Kinect[C]∥International Conference on Computer Modeling and Simulation,2013.Hong Kong,2013:495-500
[5] Chen Y Y.Gesture Recognition based on Kinect and Application in the Virtual Assembly Technology[J].Electronic Design Engineering,2013,21(10):4-7
[6] Liao Hong-jian,Long Xiao-li.Study on Virtual Assembly Sys-tem Based on Kinect Somatosensory Interaction[C]∥ISCC.2013:55-60
[7] Liao Hong-jian,Qu Zhe.Virtual Experiment System for Electrician Training based on Kinect and Unity 3D[C]∥MEC.2013:2659-2662
[8] Shotton J,Fitzgibbon A.Real-Time Human Pose Recognition in Parts from Single Depth Images[DB/OL].http://www.microseft.com/en-us/research/people
[9] Lepetit V,Lagger P,Fua P.Randomized Trees for Real-time Key point Recognition[C]∥CVPR.2005:775-781
[10] Comaniciu D,Meer P.Mean shift:A robust approach toward feature space analysis[C]∥IEEE Trans.PAMI.2002:603-619
[11] 余涛.Kinect 应用开发实战,用最自然的方式与机器对话[M].北京:机械工业出版社,2012:141-145,296-300

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!