Computer Science ›› 2021, Vol. 48 ›› Issue (8): 322-327.doi: 10.11896/jsjkx.200600122

• Human-Machine Interaction • Previous Articles     Next Articles

CSI Cross-domain Gesture Recognition Method Based on 3D Convolutional Neural Network

WANG Chi, CHANG Jun   

  1. College of Information,Yunnan University,Kunming 650500,China
  • Received:2020-06-21 Revised:2020-10-11 Published:2021-08-10
  • About author:WANG Chi,born in 1995,undergra-duate student.His main research in-terests include wireless perception and so on.(2110791732@qq.com)CHANG Jun,born in 1970,assistant professor,postgraduate's supervisor,is a member of China Computer Federation.His main research interests include intelligent wireless perception and wireless communication.
  • Supported by:
    Research Fund of Yunnan Province Department of Education(2019J0007).

Abstract: Gesture recognition has important application prospects in human-computer interaction.In recent years,with the rapid development of wireless communication and the Internet of Things,WiFi devices have been deployed almost anywhere,and a large number of gesture recognition methods have appeared on WiFi channel status information.At present,most researches based on CSI gesture recognition only focus on the research of gesture recognition in known domain.For unknown domain,new data in unknown scenes need to be added for additional learning and training,otherwise the recognition accuracy will be greatly reduced,limiting practicality.To address this problem,a CSI cross-domain gesture recognition method based on 3D convolutional neural network is proposed.The method realizes cross-scene gesture recognition by extracting domain-independent features,and combining with the 3D convolutional neural network learning model.In order to verify the method,experiment uses the public dataest.For 6 different gestures,the results show that the method achieves 86.50% recognition accuracy in known domain,and achieves 84.67% recognition accuracy in unknown scenes,it can achieve cross-scene gesture recognition.

Key words: 3D convolutional neural network, Channel state information, Cross-domain, Gesture recognition, WiFi

CLC Number: 

  • TN99
[1]GKIOXARI G,GIRSHICK R,DOLLÁR P,et al.Detecting and Recognizing Human-Object Interactions[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition.2018:8359-8367.
[2]XU C,PATHAK P H,MOHAPATRA P.Finger-writing with smartwatch:A case for finger and hand gesture recognition using smartwatch[C]//The 16th International Workshop on Mobile Computing Systems and Applications.2015:9-14.
[3]SHEN S,WANG H,CHOUDHURY R R.I am a Smartwatch and I can Track my User's Arm[C]//Proceedings of the 14th Annual International Conference on Mobile Systems,Applications,and Services.2016:85-96.
[4]NANDAKUMAR R,TAKAKUWA A,KOHNO T,et al.Covertband:Activity Information Leakage Using Music[J].ACM Journals,2017,1(3):1-24.
[5]FILHO J D P R,SILVA F J S,COUTINHO L R,et al.MHARS:A mobile system for human activity recognition and inference of health situations in ambient assisted living[J].Journal of Applied Computing Research,2016,5(1):44-58.
[6]WANG Y,LIU J,CHEN Y Y,et al.E-eyes:Device-free Location-oriented Activity Identification Using Fine-grained WiFi Signatures[C]//Proceedings of the 20th Annual International Conference on Mobile Computing and Networking.2014:617-628.
[7]WANG W,LIU A X,SHAHZAD M,et al.Device-Free Human Activity Recognition Using Commercial WiFi Devices [J].IEEE Journal on Selected Areas in Communications,2017,35(5):1118-1131.
[8]TIAN Z,WANG J,YANG X,et al.WiCatch:A WiFi BasedHand Gesture Recognition System [J].IEEE Access.,2018,6:16911-16923.
[9]VIRMANI A,SHAHZAD M.Position and Orientation Agnostic Gesture Recognition Using WiFi[C]//Proceedings of the 15th Annual International Conference on Mobile Systems,Applications,and Services.2017:252-264.
[10]ZHANG J,TANG Z Y,LI M,et al.CrossSense:Towards Cross-Site and Large-Scale WiFi Sensing[C]//Proceedings of the 24th Annual International Conference on Mobile Computing and Networking.2018:305-320.
[11]JIANG W J,MIAO C L,MA F L,et al.Towards Environment Independent Device Free Human Activity Recognition[C]//Proceedings of the 24th Annual International Conference on Mobile Computing and Networking.2018:289-304.
[12]ZHENG Y,ZHANG Y,QIAN K,et al.Zero-Effort Cross-Domain Gesture Recognition with WiFi[C]//Proceedings of the 17th Annual International Conference on Mobile Systems,Applications,and Services.2019:313-325.
[13]WANG W,LIU A X,SHAHZAD M,et al.Understanding and Modeling of WiFi Signal Based Human Activity Recognition[C]//Proceedings of the 21st Annual International Conference on Mobile Computing and Networking.2015:65-76.
[14]QIAN K,WU C S,YANG Z,et al.Widar:Decimeter-Level Passive Tracking via Velocity Monitoring with Commodity WiFi[C]//Proceedings of the 18th ACM International Symposium on Mobile Ad Hoc Networking and Computing.2017:1-10.
[1] ZHANG Jia, DONG Shou-bin. Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer [J]. Computer Science, 2022, 49(9): 41-47.
[2] FANG Yi-qiu, ZHANG Zhen-kun, GE Jun-wei. Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning [J]. Computer Science, 2022, 49(8): 70-77.
[3] CHEN Yan-bing, ZHONG Chao-ran, ZHOU Chao-ran, XUE Ling-yan, HUANG Hai-ping. Design of Cross-domain Authentication Scheme Based on Medical Consortium Chain [J]. Computer Science, 2022, 49(6A): 537-543.
[4] ZHOU Chu-lin, CHEN Jing-dong, HUANG Fan. WiFi-PDR Fusion Indoor Positioning Technology Based on Unscented Particle Filter [J]. Computer Science, 2022, 49(6A): 606-611.
[5] QING Chao-jin, DU Yan-hong, YE Qing, YANG Na, ZHANG Min-tao. Enhanced ELM-based Superimposed CSI Feedback Method with CSI Estimation Errors [J]. Computer Science, 2022, 49(6A): 632-638.
[6] LIU Liang, PU Hao-yang. Real-time LSTM-based Multi-dimensional Features Gesture Recognition [J]. Computer Science, 2021, 48(8): 328-333.
[7] XU Shao-wei, QIN Pin-le, ZENG Jian-chao, ZHAO Zhi-kai, GAO Yuan, WANG Li-fang. Mediastinal Lymph Node Segmentation Algorithm Based on Multi-level Features and Global Context [J]. Computer Science, 2021, 48(6A): 95-100.
[8] YOU Ling, GUAN Zhang-jun. Low-complexity Subcarrier Allocation Algorithm for Underwater OFDM Acoustic CommunicationSystems [J]. Computer Science, 2021, 48(6A): 387-391.
[9] WANG Ying-ying, CHANG Jun, WU Hao, ZHOU Xiang, PENG Yu. Intrusion Detection Method Based on WiFi-CSI [J]. Computer Science, 2021, 48(6): 343-348.
[10] LIU Xiao, YUAN Guan, ZHANG Yan-mei, YAN Qiu-yan, WANG Zhi-xiao. Hand Gesture Recognition Based on Self-adaptive Multi-classifiers Fusion [J]. Computer Science, 2020, 47(7): 103-110.
[11] JING Yu, QI Rui-hua, LIU Jian-xin, LIU Zhao-xia. Gesture Recognition Algorithm Based on Improved Multiscale Deep Convolutional Neural Network [J]. Computer Science, 2020, 47(6): 180-183.
[12] JIAN Song-lei, LU Kai. Survey on Representation Learning of Complex Heterogeneous Data [J]. Computer Science, 2020, 47(2): 1-9.
[13] TIAN Chun-yuan, YU Jiang, CHANG Jun, WANG Yan-shun. NWI:CSI Based Non-line-of-sight Signal Recognition Method [J]. Computer Science, 2020, 47(11): 327-332.
[14] JIANG Ze-tao, XU Juan-juan. Efficient Heterogeneous Cross-domain Authentication Scheme Based on Proxy Blind Signature in Cloud Environment [J]. Computer Science, 2020, 47(11): 60-67.
[15] JIA Yu-fu, LI Ming-lei, LIU Wen-ping, HU Sheng-hong, JIANG Hong-bo. Group Perception Analysis Method Based on WiFi Dissimilarity [J]. Computer Science, 2020, 47(10): 63-68.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!