Computer Science ›› 2019, Vol. 46 ›› Issue (11A): 303-308.

• Pattern Recognition & Image Processing • Previous Articles     Next Articles

Recognition of Chinese Finger Sign Language Based on Gray Level Co-occurrence Matrix and Fine Gaussian Support Vector Machine

JIANG Xian-wei1, ZHANG Miao-xian2, ZHU Zhao-song1   

  1. (School of Mathematics and Information Science,Nanjing Normal University of Special Education,Nanjing 210038,China) 1;
    (Zhou Enlai School of Government ,Nankai University,Tianjin 300071,China)2
  • Online:2019-11-10 Published:2019-11-20

Abstract: Sign language recognition is an effective way to break the barriers between communication between deaf and hearing people.Generally,Chinese sign language can be divided into gesture language and finger language.Regional and individual differences lead to a wide variety,therefore gesture language recognition is relatively difficult,which requires constant learning and training.The finger language gives the result through the expression of the Chinese pinyin letters,which is deterministic,especially in terms of name,special meaning,and abstract expression.Most of the researches in sign language recognition concentrate on a certain gesture,focusing on key features such as hand shape,direction,position and motion trajectory,and combine some learning algorithms to improve the recognition accuracy,but neglect the most basic and reliable finger recognition.To this end,an effective method using gray level co-occurrence matrix (GLCM) and fine Gaussian support vector machine (FGSVM) was proposed to solve the problem of identifying Chinese finger sign language more accurately and effectively.The research method is as follows.Firstly,the finger sign language data set was constructed.The finger language image was directly obtained by the digital camera or got from the key frame of the video,meanwhile the hand shape was segmented from the image,and each image was adjusted to N×N specific size and converted to grayscale images.Secondly,feature extraction was performed to reduce the dimension of the intensity values in the grayscale image,and at the same time,the corresponding gray level co-occurrence matrix was created,and the enhanced data features were obtained by adjusting the parameters of inter-pixel distance and angle.Finally,the extracted image feature data were submitted to the fine Gaussian support vector machine classifier based on the 10-fold cross-validation classification.Experiments on 510 Chinese finger sign language image samples from 30 categories show that the classification accuracy based on GLCM-FGSVM is up to 92.7%,and this method can be considered as effective approach in Chinese finger sign language classification.

Key words: Chinese sign language, Fine Gaussian support vector machine, Finger sign language, Gray level co-occurrence matrix, Sign language recognition

CLC Number: 

  • TP391.41
[1]ZHAN T.Pathological brain detection by artificial intelligence in magnetic resonance imaging scanning[J].Progress in ElectromagneticsResearch,2016,156:105-133.
[2]杨军辉.中国手语和汉语双语教育初探[J].中国特殊教育,2002(1):33.
[3]DIMITRIS METAXAS M D,CAROL N.Scalable ASL sign recognition using model-based machine learning and linguistically annotated corpora [C]∥8th Workshop on the Representation &Processing of Sign Languages:Involving the Language Community,Language Resources and Evaluation Conference 2018.Miyazaki,Japan,2018:1-5.
[4]PAN T Y,YL L,YEH C W,et al.Sign language recognition in complex background scene based on adaptive skin colourmodelling and support vector machine [J].International Journal of Big Data Intelligence,2018(5):1-2.
[5]司阳,任松,肖秦琨,等.基于彩色-深度图像的手语识别算法[J].科学技术与工程,2018,18(11):104-109.
[6]许天然,吴垚,苏红旗.基于移动终端的汉语手语识别技术研究[J].科技资讯,2012,19(1):24-26.
[7]林水强,吴亚东,陈永辉.基于几何特征的手势识别方法[J].计算机工程与设计,2014,35(2):637-639.
[8]郑津津,徐士海.基于结构特征提取的手语识别系统研究[D].合肥:中国科学技术大学,2015.
[9]SU R L,X C,CAO S,et al.Random Forest-Based Recognition of Isolated Sign Language Subwords Using Data from Accelerometers and Surface Electromyographic Sensors [J].Journals Sensors,2016,16(1):100.
[10]WASHEF AHMED K C,SOMA M.Vision based Hand Gesture Recognition using Dynamic Time Warping for Indian Sign Language[C]∥International Conference on Information Science (ICIS).2016:1-6.
[11]BISWAS N,CHAKRABORTY S,MULLICK S S.A parameter independent fuzzy weighted k-Nearest neighbor classifier [J].Pattern Recognition Letters,2018,101:80-87.
[12]HAO Z Y,ALIFU K,LI X H,et al.Chinese finger language re-cognition use CapsNet [J].Application Research of Computers,2018,36:216-228.
[13]PAN C.Multiple sclerosis identification by convolutional neural network with dropout and parametric ReLU[J].Journal of Computational Science,2018,28:1-10.
[14]YANG W B,YANG H C.Gesture recognition method based on convolutional neural network[J].Journal of Anhui Polytechnic University,2018,33:41-46.
[15]WU J.Fruit classification by biogeography-based optimizationand feedforward neural network [J].Expert Systems,2016,33(3):239-253.
[16]LU S.Pathological Brain Detection in Magnetic Resonance Imaging Using Combined Features and Improved Extreme Learning Machines [J].Journal of Medical Imaging and Health Informa-tics,2018,8:1486-1490.
[17]刘艳虹,顾定倩,程黎,等.我国手语使用状况的调查研究[J].语言文字应用,2013,5(2):35-41.
[19]徐鑫鑫,黄元元,胡作进.连续复杂手语中关键动作的提取算法[J].计算机科学,2018,45(S2):189-193.
[20]MELLISA P A,JEKLIN H,SAKKA N.Mammograms Classification Using Gray-level Co-occurrence Matrix and Radial Basis Function Neural Network [J].Procedia Computer Science,2015,59:83-91.
[21]LU H M.Facial Emotion Recognition Based on BiorthogonalWavelet Entropy,Fuzzy Support Vector Machine,and Stratified Cross Validation [J].IEEE Access,2016,4:8375-8385.
[22]毛思晨.基于卷积网络和长短时记忆网络的中国手语词识别方法研究[D].合肥:中国科技大学,2018.
[23]ZHOU X X,SHENG H.Combination of stationary wavelettransform and kernel support vector machines for pathological brain detection [J].Simulation,2016,92(9):827-837.
[24]ZHANG H Y,YUAN J Z.Survey on New Methods of Vision-based Hand Gesture Recognition[J].Journal of Computational Science,2017,44:1-6.
[1] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[2] GUO Dan, TANG Shen-geng, HONG Ri-chang, WANG Meng. Review of Sign Language Recognition, Translation and Generation [J]. Computer Science, 2021, 48(3): 60-70.
[3] RAN Meng-yuan, LIU Li, LI Yan-de, WANG Shan-shan. Deaf Sign Language Recognition Based on Inertial Sensor Fusion Control Algorithm [J]. Computer Science, 2021, 48(2): 231-237.
[4] ZOU Na, TIAN Jin-wen. Research on Multi Feature Fusion Infrared Ship Wake Detection [J]. Computer Science, 2018, 45(11A): 172-175.
[5] XU Xin-xin, HUANG Yuan-yuan, HU Zuo-jin. Extraction Algorithm of Key Actions in Continuous and Complex Sign Language [J]. Computer Science, 2018, 45(11A): 189-193.
[6] LIANG Wen-le, HUANG Yuan-yuan and HU Zuo-jin. Real-time Dynamic Sign Language Recognition Based on Hierarchical Matching Strategy [J]. Computer Science, 2017, 44(7): 299-303.
[7] LI Wen-li, GAO Hong-wei, JI Da-xiong and LI Yan. Optimization Method of Seabed Sediment Texture Feature Based on Genetic Algorithm [J]. Computer Science, 2016, 43(Z6): 130-133.
[8] YANG Quan and PENG Jin-ye. Chinese Sign Language Recognition Research Using SIFT-BoW and Depth Image Information [J]. Computer Science, 2014, 41(2): 302-307.
[9] ZHANG Yong-liang,LIU Chao-fan,XIAO Gang and FANG Shan-shan. Fake Fingerprint Detection Algorithm Based on Curvelet Texture Analysis and SVM-KNN Classification [J]. Computer Science, 2014, 41(12): 303-308.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!