计算机科学 ›› 2018, Vol. 45 ›› Issue (11A): 189-193.
徐鑫鑫1, 黄元元1, 胡作进2
XU Xin-xin1, HUANG Yuan-yuan1, HU Zuo-jin2
摘要: 文中提出了一种在手语动作中提取关键动作的算法。在连续复杂的手语动作中,关键动作数量少且状态相对稳定,因此利用关键动作构造手语的数据模型,将会减少不稳定因素,提高准确率。因此文中提出了一种自适应的分类算法,利用关键动作之间时间的先后关系,以及动作上的不相关性,逐步提取关键动作。实验证明,该算法不仅可以面向非特定人群,而且无论是对单独的手语词汇,还是连续的手语语句,均可以提取到全部的关键动作。关键动作可以看作是手语的基元,因此关键动作的提取对于构造新的手语数据模型以及识别手语都具有重要意义。
中图分类号:
[1]KAUR H,RANI J.A review:Study of various techniques of Hand gesture recognition[C]∥IEEE International Conference on Power Electronics,Intelligent Control and Energy Systems.IEEE,2017:1-5. [2]HAN Y.A Low-Cost Visual Motion Data Glove as an Input De-vice to Interpret Human Hand Gestures[J].IEEE Transactions on Consumer Electronics,2010,56(2):501-509. [3]OZ C,MING C L.American Sign Language word recognition with a sensory glove using artificial neural networks[J].Engineering Applications of Artificial Intelligence,2011,24(7):1204-1213. [4]TUNTAKURN A,THONGVIGITMANEE S S,SA-ING V,et al.Natural interactive 3D medical image viewer based on finger and arm gestures[C]∥Biomedical Engineering International Conference.IEEE,2013:1-5. [5]HUSSAIN I,TALUKDAR A K,SARMA K K.Hand gesture recognition system with real-time palm tracking[C]∥India Conference.IEEE,2015:1-6. [6]李长龙.基于Kinect深度图像的手势识别研究[D].成都:西华大学,2014. [7]HEO G,LEE D W,SHIN H C,et al.Hand segmentation and fingertip detection for interfacing of stereo vision-based smart glasses[C]∥IEEE International Conference on Consumer Electronics.IEEE,2015:585-586. [8]ZHAO F,LIU Z,YUXIANG L.Gesture recognition based on Kinect skeleton information[J].China Sciencepaper,2015(20). [9]BISWAS K K,BASU S K.Gesture recognition using Microsoft Kinect?[C]∥International Conference on Automation,Robo-tics and Applications.IEEE,2012:100-103. [10]ARICI T,CELEBI S,AYDIN A S,TEMIZ T T,et al.Robust gesture recognition using feature pre-processing and weighted dynamic time warping[J].Multimedia Tools & Applications,2014,72(3):3045-3062. [11]STARNER T,PENTL A.Visual Recognition of American Sign Language Using Hidden Markov Models[C]∥Proc.IEEE International Workshop on Automatic Face & Gesture Recognition.1995:189-194. [12]LI S,OKUDA M,TAKAHASHI S.Embedded Key-Frame Extraction for CG Animation by Frame Decimation[C]∥IEEE International Conference on Multimedia and Expo.IEEE,2005:1404-1407. [13]李姝蓉,黄元元,胡作进,等.非特定人群动态手语视频中的关键帧检测算法[J].小型微型计算机系统,2015,36(7):1597-1601. [14]梁文乐,黄元元,胡作进.基于二级匹配策略的实时动态手语识别[J].计算机科学,2017,44(7):299-303. [15]中国残疾人联合会教育就业部,中国聋人协会.中国手语[M].华夏出版社,2003. [16]石曼曼.面向非特定人群的动态手语语句识别系统研究与实现[D].南京:南京航空航天大学,2017. |
[1] | 周乐员, 张剑华, 袁甜甜, 陈胜勇. 多层注意力机制融合的序列到序列中国连续手语识别和翻译 Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion 计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026 |
[2] | 郭丹, 唐申庚, 洪日昌, 汪萌. 手语识别、翻译与生成综述 Review of Sign Language Recognition, Translation and Generation 计算机科学, 2021, 48(3): 60-70. https://doi.org/10.11896/jsjkx.210100227 |
[3] | 冉孟元, 刘礼, 李艳德, 王珊珊. 基于惯性传感器融合控制算法的聋哑手语识别 Deaf Sign Language Recognition Based on Inertial Sensor Fusion Control Algorithm 计算机科学, 2021, 48(2): 231-237. https://doi.org/10.11896/jsjkx.191200143 |
[4] | 李晨, 黄元元, 胡作进. 基于关键动作双重转移概率的连续手语语句识别算法 Continuous Sign Language Sentence Recognition Based on Double Transfer Probability of Key Actions 计算机科学, 2019, 46(11A): 299-302. |
[5] | 蒋贤维, 张妙娴, 朱兆松. 基于灰度共生矩阵和精度高斯支持向量机的中国手语手指语识别 Recognition of Chinese Finger Sign Language Based on Gray Level Co-occurrence Matrix and Fine Gaussian Support Vector Machine 计算机科学, 2019, 46(11A): 303-308. |
[6] | 郭鑫鹏,黄元元,胡作进. 基于关键帧的连续手语语句识别算法研究 Research on Continuous Sign Language Sentence Recognition Algorithm Based on Key Frame 计算机科学, 2017, 44(Z11): 178-183. https://doi.org/10.11896/j.issn.1002-137X.2017.11A.037 |
[7] | 梁文乐,黄元元,胡作进. 基于二级匹配策略的实时动态手语识别 Real-time Dynamic Sign Language Recognition Based on Hierarchical Matching Strategy 计算机科学, 2017, 44(7): 299-303. https://doi.org/10.11896/j.issn.1002-137X.2017.07.054 |
[8] | 杨全,彭进业. 采用SIFT-BoW和深度图像信息的中国手语识别研究 Chinese Sign Language Recognition Research Using SIFT-BoW and Depth Image Information 计算机科学, 2014, 41(2): 302-307. |
[9] | 吴江琴 高文. 基于ANN/HMM的手语识别方法 计算机科学, 1999, 26(10): 63-66. |
|