基于深度学习的跌倒行为识别

doi:10.11896/j.issn.1002-137X.2019.09.014

计算机科学 ›› 2019, Vol. 46 ›› Issue (9): 106-112.doi: 10.11896/j.issn.1002-137X.2019.09.014

• 第35届中国数据库学术会议 • 上一篇下一篇

基于深度学习的跌倒行为识别

马露¹, 裴伟², 朱永英³, 王春立¹, 王鹏乾¹

(大连海事大学信息科学技术学院辽宁大连116026)¹;
(大连海事大学环境科学与工程学院辽宁大连116026)²;
(大连海洋大学海洋与土木工程学院辽宁大连116026)³

收稿日期:2018-07-09 出版日期:2019-09-15 发布日期:2019-09-02
通讯作者: 裴伟(1977-),男,博士,副教授,主要研究方向为图像处理、数据挖掘,E-mail:peiwei2002@163.com
作者简介:马露(1993-),女,硕士生,主要研究方向为图像处理、异常行为识别,E-mail:malu930310@163.com;朱永英(1978-),女,博士,副教授,主要研究方向为模式识别;王春立(1972-),女,教授,主要研究方向为模式识别与数据挖掘;王鹏乾(1997-),男,主要研究方向为电子信息工程、数据挖掘。
基金资助:
国家自然科学基金项目(61001158,61001158,61370070),辽宁省自然科学基金项目(2014025003),辽宁省教育厅科学研究一般项目(L2012270),大连市科技创新基金(2018J12GX043),辽宁省重点研发计划指导计划项目

Fall Action Recognition Based on Deep Learning

MA Lu¹, PEI Wei², ZHU Yong-ying³, WANG Chun-li¹, WANG Peng-qian¹

(College of Information Science and Technology,Dalian Maritime University,Dalian,Liaoning 116026,China)¹;
(College of Environmental Science and Engineering,Dalian Maritime University,Dalian,Liaoning 116026,China)²;
(Ocean and Civil Engineering Department,Dalian Ocean University,Dalian,Liaoning 116026,China)³

Received:2018-07-09 Online:2019-09-15 Published:2019-09-02

摘要/Abstract

摘要： 随着老龄人口的快速增长,跌倒检测成为医疗健康领域的一个关键问题。准确检测监控视频中的跌倒行为并及时反馈能有效减少老年人因跌倒造成的伤害甚至死亡。针对监控视频中的复杂场景及多种相似性人类行为干扰的情况,文中提出一种改进的FSSD(Feature Fusion Single Shot Multibox Detector)跌倒检测方法。首先,从不同的跌倒视频序列中抽取视频帧形成数据集;然后,将训练样本集输入到改进的FSSD网络中训练直至网络收敛;最后,根据最优化的网络模型测试视频中目标的类别并定位目标。实验结果表明,改进的FSSD 算法可以有效检测每帧图像的跌倒或日常生活活动(Activities of Daily Living,ADL)事件并给出实时反馈,检测速度为24fps(GTX1050Ti),在保证检测精度的同时满足实时性要求。将改进方法与已有最新方法进行比较,结果表明:改进的FSSD 算法的性能优于其他算法。视频中跌倒行为的检测进一步验证了基于深度学习的识别方法的可行性与高效性。

关键词: FSSD目标检测算法, 跌倒检测, 卷积神经网路, 深度学习, 行为检测

Abstract: With the rapid growth of the aging population,fall detection has become a key issue in the medical and health field.Accurately detecting falling events in the monitoring video and giving feedback in real time can effectively reduce injuries even deaths caused by falls in the elderly.In view of the complex scenes in the monitoring video and multiple similar human behaviors,this paper proposed an improved FSSD (Feature Fusion Single Shot Multibox Detector) fall detection method.Firstly,a video frame forming dataset is extracted from different falling video sequences.Then,the training sample set is input into the improved convolutional neural network until the network converges.Finally,the target category and the location of the target in the video are tested according to the optimized network model.The experimental results show that the improved FSSD algorithm can effectively detect the falling or ADL activities of each frame of image and provide real-time feedback.The detection speed is 24fps (GTX1050Ti),which can meet the real-time requirements while ensuring the detection accuracy.Comparing the improved method with the state-of-the-art fall detection methods,the performance of the improved FSSD is better than other algorithms.The detection of fall behavior in video further validates the feasibility and efficiency of the recognition method based on deep learning.

Key words: Action detection, Convolutional neural network, Deep learning, Fall detection, FSSD target detection algorithm

中图分类号:

TP391

马露, 裴伟, 朱永英, 王春立, 王鹏乾. 基于深度学习的跌倒行为识别[J]. 计算机科学, 2019, 46(9): 106-112. https://doi.org/10.11896/j.issn.1002-137X.2019.09.014

MA Lu, PEI Wei, ZHU Yong-ying, WANG Chun-li, WANG Peng-qian. Fall Action Recognition Based on Deep Learning[J]. Computer Science, 2019, 46(9): 106-112. https://doi.org/10.11896/j.issn.1002-137X.2019.09.014

参考文献

[1]PENG Y A.A Technical Guide to Falling Interventions for the Elderly[J].Journal of Practical Rural Doctors,2012,19(8):1-13.(in Chinese)彭宇案.老年人跌倒干预技术指南[J].中国实用乡村医生杂志,2012,19(8):1-13.
[2]SANNINO G,FALCO I DE,PIETRO G DE.A supervised approach to automatically extract a set of rules to support fall detection in an mHealth system[J].Applied Soft Computing,2015,34(C):205-216.
[3]National Bureau of Statistics of the People’s Republic of China. Statistical Communique of the 2017 National Economic and Social Development of the People’s Republic of China[J].China Statistics,2018(3):7-20.(in Chinese)中国人民共和国国家统计局.中华人民共和国2017年国民经济和社会发展统计公报[J].中国统计,2018(3):7-20.
[4]NOURY N,FLEURY A,RUMEAU P,et al.Fall Detection-principles and Methods//29th Annual International Conference of the IEEE on Engineering in Medicine and Biology Society.Lyon,France,2007:1663-1666.
[5]MUBASHIR M,SHAO L,SEED L.A survey on fall detection:Principles and approaches[J].Neurocomputing,2013,100:144-152.
[6]RATHI N,KAKANI M,EL-SHARKAWY M,et al.Wearablelow power pre-fall detection system with IoT and bluetooth capabilities[C]//IEEE National Aerospace and Electronics Conference (NAECON).Dayton,OH,2017:241-244.
[7]HOSSAIN F,ALI M L,ISLAM M Z,et al.A direction-sensitive fall detection system using single 3D accelerometer and learning classifier[C]//International Conference on Medical Engineering,Health Informatics and Technology (MediTec).Dhaka,2016:1-6.
[8]SCHWICKERT L,BECKER C,LINDEMANN U,et al.Fall detection with body-worn sensors?:a systematic review[J].Zeitschrift Für Gerontologie Und Geriatrie,2013,46(8):706-719.
[9]YAZAR A,ÇETIN A E.Ambient assisted smart home designusing vibration and PIR sensors[C]//21st Signal Processing and Communications Applications Conference (SIU).Haspolat,2013:1-4.
[10]ARSHAD A,KHAN S,ALAM A H M Z,et al.A capacitive proximity sensing scheme for human motion detection[C]//IEEE International Instrumentation and Measurement Techno-logy Conference(I2MTC).Turin,2017:1-5.
[11]REN S,GIRSHICK R,GIRSHICK R,et al.Faster R-CNN:Towards Real-Time Object Detection with Region Proposal Networks[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2015,39(6):1137-1149.
[12]REDMON J,DIVVALA S,GIRSHICK R,et al.You Only Look Once:Unified,Real-Time Object Detection[C]//IEEE Confer-ence on Computer Vision and Pattern Recognition (CVPR).Las Vegas,NV,2016:779-788.
[13]LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single shotmultibox detector[J].arXiv:1512.02325v2,2015.
[14]ZHOU X Y,WANG K,LI L Y.Review of object detection based on deep learning[J].Electronic Measurement Technology,2017(11):89-93.(in Chinese)周晓彦,王珂,李凌燕.基于深度学习的目标检测算法综述[J].电子测量技术,2017(11):89-93.
[15]FU C,LIU W,RANGA A,et al.DSSD:Deconvolutional single shot detector[J].arXiv:1701.06659,2016.
[16]JEONG J,PARK H,KWAK N.Enhancement of ssd by concatenating feature maps for object detection[J].arXiv:1705.09587,2017.
[17]LI Z,ZHOU F.FSSD:Feature fusion single shot multibox detector[J].arXiv preprint arXiv:1712.00960,2017.
[18]SHEN Z,LIU Z,LI J,et al.DSOD:Learning Deeply Supervised Object Detectors from Scratch//Proceedings of the IEEE International Conference on Computer Vision.2017:1937-1945.
[19]ZHANG Z,CONLY C,ATHITSOS V.A survey on vision-based fall detection[C]//8th ACM International Conference on PErvasive Technologies Related to Assistive Environments.2015:1-7.
[20]MITERAN J,DUBOIS J,ATRI M.Optimized spatio-temporal descriptors for real-time fall detection:comparison of support vector machine and Adaboost-based classification[J].Journal of Electronic Imaging,2013,22(4):41106.
[21]YUN Y,INNOCENTI C,NERO G,et al.Fall detection in RGB-D videos for elderly care[C]//17th International Conference on E-health Networking.Boston,MA,2015:422-427.
[22]LECUN Y,BENGIO Y,HINTON G.Deep learning[J].Nature,2015,521(7553):436.
[23]ADHIKARI K,BOUCHACHIA H,NAIT-CHARIF H.Activity recognition for indoor fall detection using convolutional neural network[C]//Fifteenth IAPR International Conference on Machine Vision Applications.Nagoya,2017:81-84.
[24]HUANG C D,WANG C Y,WANG J.Human action recognition system for elderly and children care using three stream ConvNet[C]//International Conference on Orange Technologies.Hong Kong,2016:5-9.
[25]SIMONYAN K,ZISSERMAN A.Two-stream convolutionalnetworks for action recognition in videos[J].Advances in Neural Information Processing Systems,2014,1(4):568-576.
[26]MIN W,CUI H,RAO H,et al.Detection of Human Falls on Furniture Using Scene Analysis Based on Deep Learning and Activity Characteristics[J].IEEE Access,2018,PP(99):1.
[27]HE K,SUN J.Convolutional neural networks at constrainedtime cost[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).2015:5353-5360.
[28]ROUGIER C,MEUNIER J,ST-ARNAUD A,et al.Robust Video Surveillance for Fall Detection Based on Human Shape Deformation.IEEE Transactions on Circuits and Systems for Video Technology,2011,21(5):611-622.
[29]MIRMAHBOUB B,SAMAVI S,KARIMI N,et al.Automatic monocular system for human fall detection based on variations in silhouette area[J].IEEE Transactions on Biomedical Engineering,2013,60(2):427-436.

相关文章 15

[1]	饶志双, 贾真, 张凡, 李天瑞. 基于Key-Value关联记忆网络的知识图谱问答方法 Key-Value Relational Memory Networks for Question Answering over Knowledge Graph 计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2]	汤凌韬, 王迪, 张鲁飞, 刘盛云. 基于安全多方计算和差分隐私的联邦学习方案 Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy 计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[3]	徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺. 时序知识图谱表示学习 Temporal Knowledge Graph Representation Learning 计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[4]	王剑, 彭雨琦, 赵宇斐, 杨健. 基于深度学习的社交网络舆情信息抽取方法综述 Survey of Social Network Public Opinion Information Extraction Based on Deep Learning 计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[5]	郝志荣, 陈龙, 黄嘉成. 面向文本分类的类别区分式通用对抗攻击方法 Class Discriminative Universal Adversarial Attack for Text Classification 计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[6]	姜梦函, 李邵梅, 郑洪浩, 张建朋. 基于改进位置编码的谣言检测模型 Rumor Detection Model Based on Improved Position Embedding 计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[7]	孙奇, 吉根林, 张杰. 基于非局部注意力生成对抗网络的视频异常事件检测方法 Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection 计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[8]	胡艳羽, 赵龙, 董祥军. 一种用于癌症分类的两阶段深度特征选择提取算法 Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification 计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[9]	程成, 降爱莲. 基于多路径特征提取的实时语义分割方法 Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction 计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[10]	侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木. 中文预训练模型研究进展 Advances in Chinese Pre-training Models 计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[11]	周慧, 施皓晨, 屠要峰, 黄圣君. 基于主动采样的深度鲁棒神经网络学习 Robust Deep Neural Network Learning Based on Active Sampling 计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[12]	苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫. 小样本雷达辐射源识别的深度学习方法综述 Survey of Deep Learning for Radar Emitter Identification Based on Small Sample 计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[13]	刘伟业, 鲁慧民, 李玉鹏, 马宁. 指静脉识别技术研究综述 Survey on Finger Vein Recognition Research 计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056
[14]	孙福权, 崔志清, 邹彭, 张琨. 基于多尺度特征的脑肿瘤分割算法 Brain Tumor Segmentation Algorithm Based on Multi-scale Features 计算机科学, 2022, 49(6A): 12-16. https://doi.org/10.11896/jsjkx.210700217
[15]	康雁, 徐玉龙, 寇勇奇, 谢思宇, 杨学昆, 李浩. 基于Transformer和LSTM的药物相互作用预测 Drug-Drug Interaction Prediction Based on Transformer and LSTM 计算机科学, 2022, 49(6A): 17-21. https://doi.org/10.11896/jsjkx.210400150

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

基于深度学习的跌倒行为识别

Fall Action Recognition Based on Deep Learning

PDF (PC)

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

Metrics

本文评价

推荐阅读 0