计算机科学 ›› 2022, Vol. 49 ›› Issue (11A): 210800185-6.doi: 10.11896/jsjkx.210800185

• 图像处理&多媒体技术 • 上一篇    下一篇

简单背景下基于OpenCV的静态手势识别

徐玥1, 周辉2   

  1. 1 西安交通大学计算机科学与技术学院 西安 710049
    2 海南大学计算机科学与技术学院 海口 570228
  • 出版日期:2022-11-10 发布日期:2022-11-21
  • 通讯作者: 周辉(zhouhui@hainanu.edu.cn)
  • 作者简介:(xuyuexyy@126.com)
  • 基金资助:
    国家自然科学基金(61962017);海南省重点研究开发项目(ZDYF2020018);国家重点研究开发计划(2018YFB2100805)

Static Gesture Recognition Based on OpenCV in Simple Background

XU Yue1, ZHOU Hui21 School of Computer Science, Technology, Xi’an Jiaotong University, Xi’an 710049, China   

  1. 1 School of Computer Science and Technology,Xi'an Jiaotong University,Xi'an 710049,China
    2 School of Computer Science and Technology,Hainan University,Haikou 570228,China
  • Online:2022-11-10 Published:2022-11-21
  • About author:XU Yue,born in 1999,undergraduate.Her main research interests include artificial intelligence and data mining.
    ZHOU Hui,born in 1980,Ph.D,professor.His main research interests include natural language processing,artificial intelligence writing and data visualization.
  • Supported by:
    National Science Foundation of China(61962017),Hainan Provincial Key Research and Development Program(ZDYF2020018) and National Key Research and Development Program(2018YFB2100805).

摘要: 手势识别是人机交互中极为重要的一项技术,具有较高的理论和实践探究价值。但由于手势所处背景的复杂性、个体的差异性等原因,手势识别成为一个富有挑战性的课题。因此迫切需要设计一种高效准确的手势识别算法,用以对目标手势进行有效的检测和识别。文中提出了一种改进的手势分割和手势特征提取方法,利用SVM分类器构建手势模型,对手势进行分类识别。在YCrCb颜色空间的基础上,融合OTSU阈值处理法选取阈值分割手势,提高分割的准确度;在边缘检测的基础上,使用椭圆傅里叶描述子拟合边缘,提取手势特征。实验结果表明,运用上述算法所建立的系统能够十分高效地提取手势特征信息,且在简单背景下对13种常见手势的平均识别准确率达到89.96%,能够基本满足对手势识别的精确度和稳定性的要求。

关键词: OpenCV, 肤色检测, 手势分割, 特征提取, SVM分类器

Abstract: Gesture recognition is a very important technology in human-computer interaction,which has high theoretical and practical value.However,due to the complexity of the background and individual differences,gesture recognition has become a challenging topic.Therefore,it is necessary to design an efficient and accurate gesture recognition algorithm to effectively recognize the detected target gesture.An improved method of gesture segmentation and gesture feature extraction is proposed.SVM classifier is used to construct gesture model and recognize gesture.On the basis of YCrCb color space,OTSU threshold processing method is combined to select threshold segmentation gesture to improve the accuracy of segmentation.On the basis of edge detection,the ellipse Fourier descriptor is used to fit the edge and extract gesture features.Experimental results show that the system based on the above algorithm can extract gesture feature information efficiently,and the average recognition accuracy of 13 common gestures in a simple background is 89.96%,which can basically meet the requirements of recognition accuracy and stability.

Key words: OpenCV, Skin color detection, Gesture segmentation, Feature extraction, SVM classifier

中图分类号: 

  • TP391
[1]TAO Y F,HU P F,YANG W M.Computer vision technology in smart home [J].Chinese Journal of Artificial Intelligence,2020(5):30-38.
[2]LUZHNICA G,SIMON J,LEX E,et al.A Sliding Window Approach to Natural Hand Gesture Recognition Using a Custom Data Glove[C]//2016 IEEE Symposium on 3D User nterfaces(3DUI).2016:8190.
[3]DJAMILA D,LARABI S.User-Independent System for SignLanguage Finger Spelling Recognition[J].Journal of Visual Communication and Image Representation,2014,25(5):1240-1250.
[4]DULAYATRAKUL J,PRASERTSAKUL P,KONDO T,et al.Robust Implement-ation of Hand Gesture Recognition for Remote Human-Machine Interaction[C]//2015 7th International Conference on Information Technology and Electrical Enginee-ring(ICITEE).2015:247-252.
[5]MAHMUD H,HASAN M K,ABDULLAH-AL-TARIQ,et al.Recognition of Symbolic Gestures Using Depth Information[C]//Advances in Human Computer Interaction.2018:1-13.
[6]HUSSAIN I,TALUKDAR A K,SARMA K K.Hand gesture recognition system with realtime palm tracking[C]//Annual IEEE India Conference(INDICON).2014.
[7]WANG C,LIU Z,CHAN S C.Superpixel-Based Hand Gesture Recognition With Ki-nect Depth Camera[J].IEEE Transactions on Multimedia,2015,17(1):29-39.
[8]FAGIANI M,PRINCIPI E,SQUARTINI S,et al.Signer Independent Isolated Italian Sign Recognition Based on Hidden Markov Models[J].Pattern Analysis and Applications,2015,18(2):385-402.
[9]RENH B.Gesture segmentation and recognition in complexBackground [J].Acta Automatica Sinica,2002(2):256-261.
[10]YEN C H,HUANG P Y,YANG P K,et al.An Intelligent Mo-del for Facial Skin Colour Detection[J/OL].International Journal of Optics,2020.https://doi.org/10.1155/2020/1519205.
[11]WANG Y Y.Otsu Image Threshold Segmentation MethodBased on Seagull Optimization Algorithm[J].Journal of Phy-sics:Conference Series,2020,1650(3):032181.
[12]GUO Y L.Efficiency analysis of edge detection algorithm based on OpenCV [J].Chinese Journal of Science and Technology Innovation,2019(1):87-88.
[13]ZHANG J T,LI X Y,GUO S X,et al.Shape representation based on elliptic Fourier descriptors [J].Chinese Journal of Computer Engineering and Applications,2014,50(2):170-174.
[14]ZHANG X Y,LI Q.Overview of SVM based classificationmethods[J].Chinese Journal of Sci-Tech Information,2008(28):344-345.
[15]XU Y.Image acquisition for static gesture training set and test set[OL].https://github.com/Primezzz.
[1] 张源, 康乐, 宫朝辉, 张志鸿.
基于Bi-LSTM的期货市场关联交易行为检测方法
Related Transaction Behavior Detection in Futures Market Based on Bi-LSTM
计算机科学, 2022, 49(7): 31-39. https://doi.org/10.11896/jsjkx.210400304
[2] 曾志贤, 曹建军, 翁年凤, 蒋国权, 徐滨.
基于注意力机制的细粒度语义关联视频-文本跨模态实体分辨
Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism
计算机科学, 2022, 49(7): 106-112. https://doi.org/10.11896/jsjkx.210500224
[3] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[4] 刘伟业, 鲁慧民, 李玉鹏, 马宁.
指静脉识别技术研究综述
Survey on Finger Vein Recognition Research
计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056
[5] 高元浩, 罗晓清, 张战成.
基于特征分离的红外与可见光图像融合算法
Infrared and Visible Image Fusion Based on Feature Separation
计算机科学, 2022, 49(5): 58-63. https://doi.org/10.11896/jsjkx.210200148
[6] 左杰格, 柳晓鸣, 蔡兵.
基于图像分块与特征融合的户外图像天气识别
Outdoor Image Weather Recognition Based on Image Blocks and Feature Fusion
计算机科学, 2022, 49(3): 197-203. https://doi.org/10.11896/jsjkx.201200263
[7] 任首朋, 李劲, 王静茹, 岳昆.
基于集成回归决策树的lncRNA-疾病关联预测方法
Ensemble Regression Decision Trees-based lncRNA-disease Association Prediction
计算机科学, 2022, 49(2): 265-271. https://doi.org/10.11896/jsjkx.201100132
[8] 崔琳, 王芷悦.
基于LFBank与FBank混合特征的声纹识别研究
Study on Voiceprint Recognition Based on Mixed Features of LFBank and FBank
计算机科学, 2022, 49(11A): 211000194-5. https://doi.org/10.11896/jsjkx.211000194
[9] 缪岚芯, 雷雨, 曾鹏鹏, 李晓瑜, 宋井宽.
基于粒度感知和语义聚合的图像-文本检索网络
Granularity-aware and Semantic Aggregation Based Image-Text Retrieval Network
计算机科学, 2022, 49(11): 134-140. https://doi.org/10.11896/jsjkx.220600010
[10] 何玉林, 李旭, 金一, 黄哲学.
基于分解极限学习机的手写字符识别方法
Handwritten Character Recognition Based on Decomposition Extreme Learning Machine
计算机科学, 2022, 49(11): 148-155. https://doi.org/10.11896/jsjkx.211200265
[11] 张敏, 余增, 韩云星, 李天瑞.
面向复杂场景的行人重识别综述
Overview of Person Re-identification for Complex Scenes
计算机科学, 2022, 49(10): 138-150. https://doi.org/10.11896/jsjkx.211200207
[12] 张师鹏, 李永忠.
基于降噪自编码器和三支决策的入侵检测方法
Intrusion Detection Method Based on Denoising Autoencoder and Three-way Decisions
计算机科学, 2021, 48(9): 345-351. https://doi.org/10.11896/jsjkx.200500059
[13] 冯霞, 胡志毅, 刘才华.
跨模态检索研究进展综述
Survey of Research Progress on Cross-modal Retrieval
计算机科学, 2021, 48(8): 13-23. https://doi.org/10.11896/jsjkx.200800165
[14] 暴雨轩, 芦天亮, 杜彦辉, 石达.
基于i_ResNet34模型和数据增强的深度伪造视频检测方法
Deepfake Videos Detection Method Based on i_ResNet34 Model and Data Augmentation
计算机科学, 2021, 48(7): 77-85. https://doi.org/10.11896/jsjkx.210300258
[15] 张丽倩, 李孟航, 高珊珊, 张彩明.
面向计算机辅助舌诊关键问题的解决方案综述
Summary of Computer-assisted Tongue Diagnosis Solutions for Key Problems
计算机科学, 2021, 48(7): 256-269. https://doi.org/10.11896/jsjkx.200800223
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!