Computer Science ›› 2018, Vol. 45 ›› Issue (11A): 189-193.

• Pattem Recognition & Image Processing • Previous Articles     Next Articles

Extraction Algorithm of Key Actions in Continuous and Complex Sign Language

XU Xin-xin1, HUANG Yuan-yuan1, HU Zuo-jin2   

  1. Institute of Computer Science and Technology,Nanjing University of Aeronautics & Astronautics,Nanjing 210016,China1
    Institute of Math and Information Science,Nanjing Normal University of Special Education,Nanjing 210038,China2
  • Online:2019-02-26 Published:2019-02-26

Abstract: An algorithm of extracting key actions in sign language was brought out in this paper.In the continuous and complex sign language,the number of key actions is small and the state is relatively stable.Thus using the key actions to construct the data model of the sign language will reduce the unstable factors and improve the accuracy.In this paper,an adaptive classification algorithm was proposed,which extracts the key actions step by step according to the time order and the irrelevance among the key actions.Experiments show that the algorithm can be used for the non-specific population.Moreover,the algorithm can extract all the key actions from both the single vocabulary and the continuous sentence.Key actions can be regarded as primitives of sign language,and thus sign language can be looked upon as different combinations of those primitives as well.Therefore,as for the continuous and complex sign language,the extraction of key actions has important significance not only for the data model construction,but also for its recognition.

Key words: Motion-control device, Continuous and complex sign language, Key actions, Sign language recognition

CLC Number: 

  • TP391.41
[1]KAUR H,RANI J.A review:Study of various techniques of Hand gesture recognition[C]∥IEEE International Conference on Power Electronics,Intelligent Control and Energy Systems.IEEE,2017:1-5.
[2]HAN Y.A Low-Cost Visual Motion Data Glove as an Input De-vice to Interpret Human Hand Gestures[J].IEEE Transactions on Consumer Electronics,2010,56(2):501-509.
[3]OZ C,MING C L.American Sign Language word recognition with a sensory glove using artificial neural networks[J].Engineering Applications of Artificial Intelligence,2011,24(7):1204-1213.
[4]TUNTAKURN A,THONGVIGITMANEE S S,SA-ING V,et al.Natural interactive 3D medical image viewer based on finger and arm gestures[C]∥Biomedical Engineering International Conference.IEEE,2013:1-5.
[5]HUSSAIN I,TALUKDAR A K,SARMA K K.Hand gesture recognition system with real-time palm tracking[C]∥India Conference.IEEE,2015:1-6.
[6]李长龙.基于Kinect深度图像的手势识别研究[D].成都:西华大学,2014.
[7]HEO G,LEE D W,SHIN H C,et al.Hand segmentation and fingertip detection for interfacing of stereo vision-based smart glasses[C]∥IEEE International Conference on Consumer Electronics.IEEE,2015:585-586.
[8]ZHAO F,LIU Z,YUXIANG L.Gesture recognition based on Kinect skeleton information[J].China Sciencepaper,2015(20).
[9]BISWAS K K,BASU S K.Gesture recognition using Microsoft Kinect?[C]∥International Conference on Automation,Robo-tics and Applications.IEEE,2012:100-103.
[10]ARICI T,CELEBI S,AYDIN A S,TEMIZ T T,et al.Robust gesture recognition using feature pre-processing and weighted dynamic time warping[J].Multimedia Tools & Applications,2014,72(3):3045-3062.
[11]STARNER T,PENTL A.Visual Recognition of American Sign Language Using Hidden Markov Models[C]∥Proc.IEEE International Workshop on Automatic Face & Gesture Recognition.1995:189-194.
[12]LI S,OKUDA M,TAKAHASHI S.Embedded Key-Frame Extraction for CG Animation by Frame Decimation[C]∥IEEE International Conference on Multimedia and Expo.IEEE,2005:1404-1407.
[13]李姝蓉,黄元元,胡作进,等.非特定人群动态手语视频中的关键帧检测算法[J].小型微型计算机系统,2015,36(7):1597-1601.
[14]梁文乐,黄元元,胡作进.基于二级匹配策略的实时动态手语识别[J].计算机科学,2017,44(7):299-303.
[15]中国残疾人联合会教育就业部,中国聋人协会.中国手语[M].华夏出版社,2003.
[16]石曼曼.面向非特定人群的动态手语语句识别系统研究与实现[D].南京:南京航空航天大学,2017.
[1] GUO Xin-peng, HUANG Yuan-yuan and HU Zuo-jin. Research on Continuous Sign Language Sentence Recognition Algorithm Based on Key Frame [J]. Computer Science, 2017, 44(Z11): 178-183.
[2] LIANG Wen-le, HUANG Yuan-yuan and HU Zuo-jin. Real-time Dynamic Sign Language Recognition Based on Hierarchical Matching Strategy [J]. Computer Science, 2017, 44(7): 299-303.
[3] YANG Quan and PENG Jin-ye. Chinese Sign Language Recognition Research Using SIFT-BoW and Depth Image Information [J]. Computer Science, 2014, 41(2): 302-307.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] . [J]. Computer Science, 2018, 1(1): 1 .
[2] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75, 88 .
[3] XIA Qing-xun and ZHUANG Yi. Remote Attestation Mechanism Based on Locality Principle[J]. Computer Science, 2018, 45(4): 148 -151, 162 .
[4] LI Bai-shen, LI Ling-zhi, SUN Yong and ZHU Yan-qin. Intranet Defense Algorithm Based on Pseudo Boosting Decision Tree[J]. Computer Science, 2018, 45(4): 157 -162 .
[5] WANG Huan, ZHANG Yun-feng and ZHANG Yan. Rapid Decision Method for Repairing Sequence Based on CFDs[J]. Computer Science, 2018, 45(3): 311 -316 .
[6] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[7] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[8] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[9] LIU Qin. Study on Data Quality Based on Constraint in Computer Forensics[J]. Computer Science, 2018, 45(4): 169 -172 .
[10] ZHONG Fei and YANG Bin. License Plate Detection Based on Principal Component Analysis Network[J]. Computer Science, 2018, 45(3): 268 -273 .