计算机科学 ›› 2025, Vol. 52 ›› Issue (11): 166-174.doi: 10.11896/jsjkx.241000115

• 计算机图形学&多媒体 • 上一篇    下一篇

基于VMD复合神经网络模型的手势动作预测

赵炼1, 吴扬东1, 邓智方1, 李丰硕1, 袁庆霓1, 张太华2   

  1. 1 贵州大学现代制造技术教育部重点实验室 贵阳 550025
    2 贵州师范大学机械与电气工程学院 贵阳 550025
  • 收稿日期:2024-10-21 修回日期:2025-03-09 出版日期:2025-11-15 发布日期:2025-11-06
  • 通讯作者: 吴扬东(ydwu@gzu.edu.cn)
  • 作者简介:(1850005054@qq.com)
  • 基金资助:
    国家自然科学基金(72061006);贵州省科技支撑项目(黔科合支撑[2023]一般094,[2020]4Y140)

Gesture Action Prediction Based on VMD Composite Neural Network Model

ZHAO Lian1, WU Yangdong1, DENG Zhifang1, LI Fengshuo1, YUAN Qingni1, ZHANG Taihua2   

  1. 1 Key Laboratory of Advanced Manufacturing Technology of the Ministry of Education,Guizhou University,Guiyang 550025,China
    2 School of Mechanical and Electrical Engineering,Guizhou Normal University,Guiyang 550025,China
  • Received:2024-10-21 Revised:2025-03-09 Online:2025-11-15 Published:2025-11-06
  • About author:ZHAO Lian,born in 2000,postgra-duate,is a member of CCF(No.Y5493G).His main research interest is intelligent rehabilitation robots.
    WU Yangdong,born in 1969,Ph.D,associate professor.His main research interests include intelligent manufactu-ring,multidisciplinary design optimization and intelligent rehabilitation robots.
  • Supported by:
    National Natural Science Foundation of China(72061006) and Guizhou Province Science and Technology Support Project(Guizhou Science and Technology Joint Support[2023]General 094,[2020]4Y140).

摘要: 表面肌电信号(Surface Electromyography,sEMG)常用于预测人体意图行为,是一种不平稳、非周期、含有噪声的生物电信号,容易受工频干扰、环境干扰等影响,导致对其进行预测存在一定难度。对此,提出了一种基于变分模态分解(Variatio-nal Mode Decomposition,VMD)和改进粒子群优化( Particle Swarm Optimization,PSO)算法的复合神经网络模型(Composite Neural Network Model,CNNM)。该模型结合了长短期记忆网络(Long-Short Term Memory,LSTM)、卷积神经网络(Convolutional Neural Networks,CNN)和双向长短期记忆网络(Bidirectional Long Short Term Memory,BiLSTM)。首先对PSO算法进行改进以优化VMD的参数,通过VMD处理sEMG信号,提出希尔伯特能量法,对分解后的分量进行加权重构,降低信号复杂性并保留关键特征。然后利用LSTM方法从sEMG信号中提取时间特征,利用CNN方法进一步提取空间特征,并通过注意力机制强化对关键信息的提取,最后输入BiLSTM中进行预测识别。实验结果表明,该模型的预测准确率可达99.9%,相较于其他模型提高了3%~8%,并通过消融实验验证了各模块的作用。该研究旨在提高手势动作的预测识别精度,为康复训练机器人的控制提供有效的解决方案。

关键词: 表面肌电信号, 变分模态分解, 卷积神经网络, 长短期记忆网络, 双向长短期记忆网络

Abstract: sEMG is often used to predict human intention behavior.It is an unstable,non-periodic and noisy bioelectrical signal,which is easily affected by power frequency interference and environmental interference,so it is difficult to predict it.This paper proposes CNNM based onVMD and PSO algorithm.The model combines LSTM,CNN andBiLSTM.Firstly,the Ninapro dataset is used to optimize the parameters of VMD through the improved PSO algorithm,and the sEMG signal is processed by VMD.The decomposed components are weighted and reconstructed according to the Hilbert energy method,which reduces the complexity of the signal and retains the key features.Then,the LSTM method is used to extract the temporal features from sEMG signals,the CNN method is used to further extract the spatial features,and the attention mechanism is used to strengthen the extraction of key information.Finally,it is input into BiLSTM for prediction and recognition.Experimental results show that the prediction accuracy of the proposed model can reach 99.9%,and the prediction accuracy of CNNM is improved by 3%~8% compared with other models.Finally,the role of each module is verified by ablation experiments.This research aims to improve the prediction and recognition accuracy of gesture actions and provide an effective solution for the control of rehabilitation training robots.

Key words: Surface electromyography, Variational mode decomposition, Convolutional neural network, Long short-term memory network, Bidirectional long-short term memory network

中图分类号: 

  • TN911.72
[1]BATTISTON B,TITOLO P,CICLAMINI D,et al.Peripheral Nerve Defects:Overviews of Practice in Europe [J].Hand Cli-nics,2017,33(3):545-50.
[2]ZHOU S,ZHANG G J.Research progress on the application of robots in early rehabilitation training of patients with movement disorders after stroke [J].Chinese Nursing Research,2024,38(8):1428-1432.
[3]BERTANI R,MELEGARI C,DE COLA M C,et al.Effects of robot-assisted upper limb rehabilitation in stroke patients:a systematic review with meta-analysis [J].Neurological Sciences,2017,38(9):1561-1569.
[4] MARIANNE B,LAURENT B,JEANSÉBASTIEN R,et al.Reducing Noise,Artifacts and Interference in Single-Channel EMG Signals:A Review [J].Sensors,2023,23(6):2927.
[5]ZHENG Y,ZHENG G,ZHANG H,et al.Mapping Method ofHuman Arm Motion Based on Surface Electromyography Signals [J].Sensors,2024,24(9):2827.
[6]HUO Y D,LI F B,LI Q,et al.A Novel Method for Hand Movement Recognition Based on Wavelet Packet Transform and Principal Component Analysis with Surface Electromyogram [J].Computational Intelligence and Neuroscience,2022,2022(1):8125186.
[7]ZHANG Q,LUO W Y,HUANG B,et al.Continuous kinematics prediction of lower limb driven by EMG [J].Journal of Huazhong University of Science and Technology(Nature Science Edition),2017,45(10):128-132.
[8]TRIWIYANTO T,VUGAR A,ALI A A.Deep ConvolutionNeural Network to Improve Hand Motion Classification Performance Against Varying Orientation Using Electromyography Signal [J].International Journal of Precision Engineering and Manufacturing,2024,25(6):1289-1301.
[9]WEI W T,LI Y J.Surface electromyography based gesture re-cognition based on dual-stream CNN [J].Computer Integrated Manufacturing Systems,2022,28(1):124-131.
[10]ARJAN G,MANFREDO A,CLAUDIO C,et al.Movement error rate for evaluation of machine learning methods for sEMG-based hand movement classification [J].IEEE Transactions on Neural Systems and Rehabilitation Engineering,2014,22(4):735-744.
[11]JIANG H Y,XU X J,ZHONG L J,et al.Gesture Recognition of Surface Electromyography Based on Variational Mode Decomposition and Domain Adaptation [J].Journal of Xi'an Jiaotong University,2024,58(5):75-87.
[12]DRAGOMIRETSKIY K,ZOSSO D.Variational Mode Decomposition [J].IEEE Transactions on Signal Processing,2014,62(3):531-544.
[13]WANG W M.Prediction of Lower Limb Joint Angle Based on VMD-ELMAN Electromyographic Signals [J].Computer Science,2024,51(3):257-264.
[14]LI X,NI R,JI Z.ICG signal denoising based on ICEEMDAN and PSO-VMD methods [J].Physical and Engineering Sciences in Medicine,2024,47:1547-1556.
[15]WENLI Z,TINGSONG Z,JIANYI Z,et al.LST-EMG-Net:Long short-term transformer feature fusion network for sEMG gesture recognition [J].Frontiers in Neurorobotics,2023,17:1127338.
[16]VASANTHI S M,LENIN A H,FOUAD Y,et al.Electromyography signal based hand gesture classification system using Hilbert Huang transform and deep neural networks [J].He-liyon,2024,10(11):e32211.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!