基于LSTM的CSI手势识别方法

摘要/Abstract

摘要： 基于WiFi的信道状态信息(Channel State Information,CSI)的手势识别在人机交互中具有广泛的应用前景。目前,大多数的CSI手势识别方法需人工提取特征,特征提取的过程繁琐,且只能识别特定方向的手势,限制了人的活动范围。针对上述问题,提出了利用长短时记忆神经网络(Long Short-Term Memory,LSTM)训练的方法,设计了一个基于LSTM的CSI手势识别系统。该系统将采集到的CSI数据首先进行异常点去除、最优子载波选择和离散小波变化去噪等预处理操作;然后通过LSTM网络训练分类,无需人工提取手势特征;最终实现推、拉、左挥、右挥4种手势在4个不同方向的识别,平均准确率达到了82.75%。文中分别讨论了发送到接收端的距离与数据集大小对手势识别准确率的影响,并对比WiG和WiFinger方法识别4个方向手势的识别准确率,结果表明文中所提方法具有更高的识别效果。

关键词: WiFi, 长短时记忆神经网络, 离散小波变换, 手势识别, 信道状态信息

Abstract: Gesture recognition based on WiFi channel state information (CSI) has broad application prospects in human-computer interaction.At present,most methods require manual extraction of features,and the feature extraction process is cumbersome.It can only recognize gestures in a specific direction,which limits the range of people’s activities.To solve the above problems,this paper proposed a method based on Long Short-Term Memory (LSTM) training to design a CSI gesture recognition system based on LSTM.The system preprocesses the collected CSI data through such as abnormal point removal,optimal subcarrier selection and discrete wavelet variation denoising.The LSTM network trains the classification without manual extraction of gesture features.Finally,the recognition of four gestures is achieved,which are pushing,pulling,left swing and right swing in four different directions,and an average recognition accuracy of 82.75% is reached.This paper discussed the influence of the distance between sender and receiver and the size of the data set on the accuracy of gesture recognition,and compared the gestures in four directions by WiG and WiFinger.The results show that the proposed method has higher recognition effect.

Key words: Channel state information, Discrete wavelet transform, Gesture recognition, Long short-term memory, WiFi

中图分类号:

TP183

刘佳慧, 王昱洁, 雷艺. 基于LSTM的CSI手势识别方法[J]. 计算机科学, 2019, 46(11A): 283-288. https://doi.org/

LIU Jia-hui, WANG Yu-jie, LEI Yi. CSI Gesture Recognition Method Based on LSTM[J]. Computer Science, 2019, 46(11A): 283-288. https://doi.org/

参考文献

[1]NÚÑEZ J C,CABIDO R,PANTRIGO J J,et al.Convolutional Neural Networks and Long Short-TermMemory for skeleton-based human activity and hand gesture recognition[J].Pattern Recognition,2018,76:80-94.
[2]ZHANG J,LI W,OGUNBONA P O,et al.RGB-D-based action recognition datasets:a survey[J].Pattern Recognition,2016,60:86-105.
[3]Leap Motion.Leap Motion Controller[EB/OL].[2014-12-28].https://www.leapmotion.com.
[4]Point Grab.Virtual Touch [EB/OL].[2014-12-29].http://www.pointgrab.com
[5]CHOI J J U,AE CHUN S,CHO J W.Smart Secure- Gov:mobile government security framework [C]∥Procee-dings of the 15^th Annual International Conference on Digital Government Research.New York:ACM,2014:91-99.
[6]鲁勇,吕绍和,王晓东,等.基于WiFi信号的人体行为感知技术研究综述[J].计算机学报,2017,53(9):170-183.
[7]PU Q,GUPTA S,GOLLAKOTA S,et al.Whole-home gesture recognition using wireless signals[C]∥Proceedings of the 19th Annual International Conference on Mobile Computing and Networking.New York,USA,2013:27-3.
[8]SIGG S,BLANKE U,TROSTER G.The telepathic phone:Frict-ionless activity recognition from wifi-rssi[C]∥Procee-dings of the IEEE international conference on Pervasive Computing and Communications.Budapest:IEEE,2014:148-155.
[9]ABDELNASSER H,YOUSSEF M,HARRAS K A.Wigest:Aubiquitous wifi-based gesture recognition system [C]∥Proceedings of the 2015 IEEE Conference on Computer Communications.Hong Kong,China,2015:1472-1480.
[10]HE W,WU K,ZOU Y,et al.Wig:Wifi-based gest-ure recognition system[C]∥Proceedings of the 24th International Conference on Computer Communication and Networks.Las Vegas,USA,2015:1-7.
[11]LI H,YANG W,WANG J,et al.Wifinger:Talk to your smart devices with finger-grained gesture[C]∥Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing.New York,USA,2016:250-261.
[12]QIAN K,WU C S,ZHOU Z M,et al.Inferri-ng Motion Direction using Commodity Wi-Fi for Interactive Exergames[C]∥ACM SIGCHI Conference on Human Factors in Computing Systems(CHI).ACM,2017:6-11.
[13]HALPERIN D,HU W,SHETH A,et al.Tool release:ga-thering 802.11n traces with channel state infor-mation [J].ACM SIGCOMM Computer Comm-unication Review,2011,41(1):53-53.
[14]杨铮,刘云浩.Wi-Fi雷达:从 RSSI 到 CSI [J].中国计算机学会通讯,2014,10(11):55-60
[15]WANG W,LIU A.X,SHAHZAD M,et al.Understanding and modeling of wifi signal based human activity recognition[C]∥Proceedings of the 21st Annual International Conference on Mobile Computing and Networking.New York,USA,2015:65-76.
[16]WANG H,ZHANG D,MA J,et al.Human respiration det-ection with commodity wifi devices:Do user location and bodyorien-tation matter[C]∥Proceedings of the 2016 ACM InternationalJoint Conference on Pervasive and Ubiquitous Computing.New York,USA,2016:25-36.
[17]WU D,ZHANG D,XU C,et al.Widir:Walking direction estimation using wireless signals[C]∥Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing.New York,USA,2016:351-362.
[18]BREUNIG M M,KRIEGEL H P,NG R T,et al.LOF:identifying density-based local outliers[C]∥Proceedings of the ACM SIGMOD 2000 Int.Conf.on Management of Data.ACM,2000:93-104.
[19]CHOI J S,LEE W H,LEE J H,et al.Deep Learning Based NLOS Identification with Commodity WLAN Devices [J].IEEE Transactions on Vehicular Technology,2018,67:3295-3303.

相关文章 15

[1]	来腾飞, 周海洋, 余飞鸿. 视频流的实时景深延拓算法 Real-time Extend Depth of Field Algorithm for Video Processing 计算机科学, 2022, 49(6A): 314-318. https://doi.org/10.11896/jsjkx.201100187
[2]	孙洁琪, 李亚峰, 张文博, 刘鹏辉. 基于离散小波变换的双域特征融合深度卷积神经网络 Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation 计算机科学, 2022, 49(6A): 434-440. https://doi.org/10.11896/jsjkx.210900199
[3]	周楚霖, 陈敬东, 黄凡. 基于无迹粒子滤波的WiFi-PDR融合室内定位技术 WiFi-PDR Fusion Indoor Positioning Technology Based on Unscented Particle Filter 计算机科学, 2022, 49(6A): 606-611. https://doi.org/10.11896/jsjkx.210700108
[4]	卿朝进, 杜艳红, 叶青, 杨娜, 张岷涛. 存在CSI估计错误的增强型ELM叠加CSI反馈方法 Enhanced ELM-based Superimposed CSI Feedback Method with CSI Estimation Errors 计算机科学, 2022, 49(6A): 632-638. https://doi.org/10.11896/jsjkx.210800036
[5]	王炽, 常俊. 基于3D卷积神经网络的CSI跨场景手势识别方法 CSI Cross-domain Gesture Recognition Method Based on 3D Convolutional Neural Network 计算机科学, 2021, 48(8): 322-327. https://doi.org/10.11896/jsjkx.200600122
[6]	刘亮, 蒲浩洋. 基于LSTM的多维度特征手势实时识别 Real-time LSTM-based Multi-dimensional Features Gesture Recognition 计算机科学, 2021, 48(8): 328-333. https://doi.org/10.11896/jsjkx.210300079
[7]	尤凌, 管张均. 一种低复杂度的水声OFDM通信系统子载波分配算法 Low-complexity Subcarrier Allocation Algorithm for Underwater OFDM Acoustic CommunicationSystems 计算机科学, 2021, 48(6A): 387-391. https://doi.org/10.11896/jsjkx.201100064
[8]	王颖颖, 常俊, 武浩, 周详, 彭予. 基于WiFi-CSI的入侵检测方法 Intrusion Detection Method Based on WiFi-CSI 计算机科学, 2021, 48(6): 343-348. https://doi.org/10.11896/jsjkx.200700006
[9]	刘肖, 袁冠, 张艳梅, 闫秋艳, 王志晓. 基于自适应多分类器融合的手势识别 Hand Gesture Recognition Based on Self-adaptive Multi-classifiers Fusion 计算机科学, 2020, 47(7): 103-110. https://doi.org/10.11896/jsjkx.200100073
[10]	景雨, 祁瑞华, 刘建鑫, 刘朝霞. 基于改进多尺度深度卷积网络的手势识别算法 Gesture Recognition Algorithm Based on Improved Multiscale Deep Convolutional Neural Network 计算机科学, 2020, 47(6): 180-183. https://doi.org/10.11896/jsjkx.200200030
[11]	田春元, 余江, 常俊, 王彦舜. NWI:基于CSI的非视距信号识别方法 NWI:CSI Based Non-line-of-sight Signal Recognition Method 计算机科学, 2020, 47(11): 327-332. https://doi.org/10.11896/jsjkx.190900019
[12]	贾玉福, 李明磊, 刘文平, 胡胜红, 蒋洪波. 一种基于WiFi相异度的群组感知分析方法 Group Perception Analysis Method Based on WiFi Dissimilarity 计算机科学, 2020, 47(10): 63-68. https://doi.org/10.11896/jsjkx.200600014
[13]	韩笑, 张晶, 李月龙. 基于手势几何分布特征的手势识别 Gesture Recognition Based on Hand Geometric Distribution Feature 计算机科学, 2019, 46(6A): 246-249.
[14]	葛娜, 孙连英, 石晓达, 赵平. Prophet-LSTM组合模型的销售量预测研究 Research on Sales Forecast of Prophet-LSTM Combination Model 计算机科学, 2019, 46(6A): 446-451.
[15]	郑诚, 洪彤彤, 薛满意. 用于短文本分类的BLSTM_MLPCNN模型 BLSTM_MLPCNN Model for Short Text Classification 计算机科学, 2019, 46(6): 206-211. https://doi.org/10.11896/j.issn.1002-137X.2019.06.031

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed