Computer Science ›› 2025, Vol. 52 ›› Issue (11): 166-174.doi: 10.11896/jsjkx.241000115

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Gesture Action Prediction Based on VMD Composite Neural Network Model

ZHAO Lian1, WU Yangdong1, DENG Zhifang1, LI Fengshuo1, YUAN Qingni1, ZHANG Taihua2   

  1. 1 Key Laboratory of Advanced Manufacturing Technology of the Ministry of Education,Guizhou University,Guiyang 550025,China
    2 School of Mechanical and Electrical Engineering,Guizhou Normal University,Guiyang 550025,China
  • Received:2024-10-21 Revised:2025-03-09 Online:2025-11-15 Published:2025-11-06
  • About author:ZHAO Lian,born in 2000,postgra-duate,is a member of CCF(No.Y5493G).His main research interest is intelligent rehabilitation robots.
    WU Yangdong,born in 1969,Ph.D,associate professor.His main research interests include intelligent manufactu-ring,multidisciplinary design optimization and intelligent rehabilitation robots.
  • Supported by:
    National Natural Science Foundation of China(72061006) and Guizhou Province Science and Technology Support Project(Guizhou Science and Technology Joint Support[2023]General 094,[2020]4Y140).

Abstract: sEMG is often used to predict human intention behavior.It is an unstable,non-periodic and noisy bioelectrical signal,which is easily affected by power frequency interference and environmental interference,so it is difficult to predict it.This paper proposes CNNM based onVMD and PSO algorithm.The model combines LSTM,CNN andBiLSTM.Firstly,the Ninapro dataset is used to optimize the parameters of VMD through the improved PSO algorithm,and the sEMG signal is processed by VMD.The decomposed components are weighted and reconstructed according to the Hilbert energy method,which reduces the complexity of the signal and retains the key features.Then,the LSTM method is used to extract the temporal features from sEMG signals,the CNN method is used to further extract the spatial features,and the attention mechanism is used to strengthen the extraction of key information.Finally,it is input into BiLSTM for prediction and recognition.Experimental results show that the prediction accuracy of the proposed model can reach 99.9%,and the prediction accuracy of CNNM is improved by 3%~8% compared with other models.Finally,the role of each module is verified by ablation experiments.This research aims to improve the prediction and recognition accuracy of gesture actions and provide an effective solution for the control of rehabilitation training robots.

Key words: Surface electromyography, Variational mode decomposition, Convolutional neural network, Long short-term memory network, Bidirectional long-short term memory network

CLC Number: 

  • TN911.72
[1]BATTISTON B,TITOLO P,CICLAMINI D,et al.Peripheral Nerve Defects:Overviews of Practice in Europe [J].Hand Cli-nics,2017,33(3):545-50.
[2]ZHOU S,ZHANG G J.Research progress on the application of robots in early rehabilitation training of patients with movement disorders after stroke [J].Chinese Nursing Research,2024,38(8):1428-1432.
[3]BERTANI R,MELEGARI C,DE COLA M C,et al.Effects of robot-assisted upper limb rehabilitation in stroke patients:a systematic review with meta-analysis [J].Neurological Sciences,2017,38(9):1561-1569.
[4] MARIANNE B,LAURENT B,JEANSÉBASTIEN R,et al.Reducing Noise,Artifacts and Interference in Single-Channel EMG Signals:A Review [J].Sensors,2023,23(6):2927.
[5]ZHENG Y,ZHENG G,ZHANG H,et al.Mapping Method ofHuman Arm Motion Based on Surface Electromyography Signals [J].Sensors,2024,24(9):2827.
[6]HUO Y D,LI F B,LI Q,et al.A Novel Method for Hand Movement Recognition Based on Wavelet Packet Transform and Principal Component Analysis with Surface Electromyogram [J].Computational Intelligence and Neuroscience,2022,2022(1):8125186.
[7]ZHANG Q,LUO W Y,HUANG B,et al.Continuous kinematics prediction of lower limb driven by EMG [J].Journal of Huazhong University of Science and Technology(Nature Science Edition),2017,45(10):128-132.
[8]TRIWIYANTO T,VUGAR A,ALI A A.Deep ConvolutionNeural Network to Improve Hand Motion Classification Performance Against Varying Orientation Using Electromyography Signal [J].International Journal of Precision Engineering and Manufacturing,2024,25(6):1289-1301.
[9]WEI W T,LI Y J.Surface electromyography based gesture re-cognition based on dual-stream CNN [J].Computer Integrated Manufacturing Systems,2022,28(1):124-131.
[10]ARJAN G,MANFREDO A,CLAUDIO C,et al.Movement error rate for evaluation of machine learning methods for sEMG-based hand movement classification [J].IEEE Transactions on Neural Systems and Rehabilitation Engineering,2014,22(4):735-744.
[11]JIANG H Y,XU X J,ZHONG L J,et al.Gesture Recognition of Surface Electromyography Based on Variational Mode Decomposition and Domain Adaptation [J].Journal of Xi'an Jiaotong University,2024,58(5):75-87.
[12]DRAGOMIRETSKIY K,ZOSSO D.Variational Mode Decomposition [J].IEEE Transactions on Signal Processing,2014,62(3):531-544.
[13]WANG W M.Prediction of Lower Limb Joint Angle Based on VMD-ELMAN Electromyographic Signals [J].Computer Science,2024,51(3):257-264.
[14]LI X,NI R,JI Z.ICG signal denoising based on ICEEMDAN and PSO-VMD methods [J].Physical and Engineering Sciences in Medicine,2024,47:1547-1556.
[15]WENLI Z,TINGSONG Z,JIANYI Z,et al.LST-EMG-Net:Long short-term transformer feature fusion network for sEMG gesture recognition [J].Frontiers in Neurorobotics,2023,17:1127338.
[16]VASANTHI S M,LENIN A H,FOUAD Y,et al.Electromyography signal based hand gesture classification system using Hilbert Huang transform and deep neural networks [J].He-liyon,2024,10(11):e32211.
[1] HUO Dan, YU Fuping, SHEN Di, HAN Xueyan. Research on Multi-machine Conflict Resolution Based on Deep Reinforcement Learning [J]. Computer Science, 2025, 52(7): 271-278.
[2] WANG Jiamin, WU Wenhong, NIU Hengmao, SHI Bao, WU Nier, HAO Xu, ZHANG Chao, FU Rongsheng. Review of Concrete Defect Detection Methods Based on Deep Learning [J]. Computer Science, 2025, 52(6A): 240900137-12.
[3] SHI Xincheng, WANG Baohui, YU Litao, DU Hui. Study on Segmentation Algorithm of Lower Limb Bone Anatomical Structure Based on 3D CTImages [J]. Computer Science, 2025, 52(6A): 240500119-9.
[4] LONG Xiao, HUANG Wei, HU Kai. Bi-MI ViT:Bi-directional Multi-level Interaction Vision Transformer for Lung CT ImageClassification [J]. Computer Science, 2025, 52(6A): 240700183-6.
[5] CHENG Yan, HE Huijuan, CHEN Yanying, YAO Nannan, LIN Guobo. Study on interpretable Shallow Class Activation Mapping Algorithm Based on Spatial Weights andInter Layer Correlation [J]. Computer Science, 2025, 52(6A): 240500140-7.
[6] WANG Baohui, GAO Zhan, XU Lin, TAN Yingjie. Research and Implementation of Mine Gas Concentration Prediction Algorithm Based on Deep Learning [J]. Computer Science, 2025, 52(6A): 240400188-7.
[7] GUO Yecai, HU Xiaowei, MAO Xiangnan. Multi-scale Feature Fusion Residual Denoising Network Based on Cascade [J]. Computer Science, 2025, 52(6): 239-246.
[8] WANG Chenyuan, ZHANG Yanmei, YUAN Guan. Class Integration Test Order Generation Approach Fused with Deep Reinforcement Learning andGraph Convolutional Neural Network [J]. Computer Science, 2025, 52(6): 58-65.
[9] WEI Xiaohui, GUAN Zeyu, WANG Chenyang, YUE Hengshan, WU Qi. Hardware-Software Co-design Fault-tolerant Strategies for Systolic Array Accelerators [J]. Computer Science, 2025, 52(5): 91-100.
[10] PANG Mingyi, WEI Xianglin, ZHANG Yunxiang, WANG Bin, ZHUANG Jianjun. Efficient Adaptive CNN Accelerator for Resource-limited Chips [J]. Computer Science, 2025, 52(4): 94-100.
[11] XIONG Qibing, MIAO Qiguang, YANG Tian, YUAN Benzheng, FEI Yangyang. Malicious Code Detection Method Based on Hybrid Quantum Convolutional Neural Network [J]. Computer Science, 2025, 52(3): 385-390.
[12] HE Yuyu, ZHOU Feng, TIAN Youliang, XIONG Wei, WANG Shuai. Lightweight Privacy-preserving Mobile Sensing Classification Framework Based on AddictiveSecret Sharing [J]. Computer Science, 2025, 52(11): 415-424.
[13] HE Hao, ZHANG Hui. Intrusion Detection Method Based on Improved Active Learning [J]. Computer Science, 2025, 52(10): 357-365.
[14] YUAN Mengjiao, LU Tianliang, HUANG Wanxin, HE Houhan. Benign-salient Region Based End-to-End Adversarial Malware Generation Method [J]. Computer Science, 2025, 52(10): 382-394.
[15] LYU Yiming, WANG Jiyang. Iron Ore Image Classification Method Based on Improved Efficientnetv2 [J]. Computer Science, 2024, 51(6A): 230600212-6.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!