计算机科学 ›› 2016, Vol. 43 ›› Issue (Z6): 187-190.doi: 10.11896/j.issn.1002-137X.2016.6A.044

• 模式识别与图像处理 • 上一篇    下一篇

基于IMU的手语识别骨骼模型构建

孙燮,陈曦   

  1. 广东工业大学机电工程学院 广州510006,广东科学中心 广州510006
  • 出版日期:2018-12-01 发布日期:2018-12-01

IMU Based Construction of Sign Language Skeleton Model

SUN Xie and CHEN Xi   

  • Online:2018-12-01 Published:2018-12-01

摘要: 手语识别属于手势识别的研究范畴。传统的基于数据手套的手语识别方法不能完整捕捉手语的所有要素,无法识别手部与肢体配合的手语动作。 惯性测量单元(IMU)由于体积小、成本低而被越来越多地应用到动作捕捉项目中。借鉴机器人运动学相关知识,提出了基于IMU的手语识别骨骼模型,该模型符合人体生物学特征。模型的构建步骤为首先进行骨骼的选取,然后进行尺寸标定。最后提出了标定模型尺寸的实验方法,使用IMU获得的动作集的数据可以进行求解。

关键词: 骨骼模型,指数积,正向运动学,模型标定

Abstract: Sign language recognition belongs to the research category of gesture recognition.The traditional method of sign language recognition based on data glove can not capture all the elements of sign language,as it can not recognize sign language movements cooperated by hand and limbs.For IMU (Inertial Measurement Unit),due to its small size,low cost,it has been applied to the motion capture project widely.Based on the knowledge of robot kinematics,we proposed an IMU based language recognition skeleton model,which is in line with the biological characteristics of human body.The first construction procedure of the model is to make a selection of the skeleton,and then tocalibrate the size of the skeleton.Finally,an experimental method was proposed to calibrate the model size,which can be solved by using the data of the action set obtained by IMU.

Key words: Skeleton model,POE,Forward kinematics,Model calibration

[1] 成娟.基于表面肌电和加速度信号融合的动作识别和人体行为分析研究[D].合肥:中国科学技术大学,2013
[2] 于松梅,张宁生.聋人手语的语言学研究[J].中国特殊教育,2004(9):61-64
[3] 赵英男.手语中面部表情信息理解的研究与实现[D].大连:大连海事大学,2012
[4] Brodie M,Walmsley A,Page W.Fusion motion capture:a prototype system using inertial measurement units and GPS for the biomechanical analysis of ski racing[J].Sports Technology,2008,1(1):17-28
[5] Goodvin C,Park E J,Huang K,et al.Development of a real-time three-dimensional spinal motion measurement system for clinical practice[J].Medical & Biological Engineering & Computing,2006,44(12):1061-1075
[6] Yuan Q,Chen I M,Lee S P.SLAC:3D localization of humanbased on kinetic human movement capture[C]∥2011 IEEE International Conference on Robotics and Automation (ICRA).IEEE,2011:848-853
[7] 马艳红,胡军.姿态四元数相关问题[J].空间控制技术与应用,2008,3(3):55-60
[8] 刘博.基于MEMS传感器的动作捕捉系统开发设计[D].北京:北京理工大学,2011
[9] 高文斌,王洪光,姜勇.一种基于指数积的串联机器人标定方法[J].机器人,2013,35(2):156-161
[10] Chen I M,Yang G,Tan C T,et al.Local POE model for robot kinematic calibration[J].Mechanism & Machine Theory,2001,36(11):1215-1239
[11] He R,Zhao Y,Yang S,et al.Kinematic-Parameter Identification for Serial-Robot Calibration Based on POE Formula[J].IEEE Transactions on Robotics,2010,26(3):411-423

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!