计算机科学 ›› 2019, Vol. 46 ›› Issue (9): 106-112.doi: 10.11896/j.issn.1002-137X.2019.09.014
马露1, 裴伟2, 朱永英3, 王春立1, 王鹏乾1
MA Lu1, PEI Wei2, ZHU Yong-ying3, WANG Chun-li1, WANG Peng-qian1
摘要: 随着老龄人口的快速增长,跌倒检测成为医疗健康领域的一个关键问题。准确检测监控视频中的跌倒行为并及时反馈能有效减少老年人因跌倒造成的伤害甚至死亡。针对监控视频中的复杂场景及多种相似性人类行为干扰的情况,文中提出一种改进的FSSD(Feature Fusion Single Shot Multibox Detector)跌倒检测方法。首先,从不同的跌倒视频序列中抽取视频帧形成数据集;然后,将训练样本集输入到改进的FSSD网络中训练直至网络收敛;最后,根据最优化的网络模型测试视频中目标的类别并定位目标。实验结果表明,改进的FSSD 算法可以有效检测每帧图像的跌倒或日常生活活动(Activities of Daily Living,ADL)事件并给出实时反馈,检测速度为24fps(GTX1050Ti),在保证检测精度的同时满足实时性要求。将改进方法与已有最新方法进行比较,结果表明:改进的FSSD 算法的性能优于其他算法。视频中跌倒行为的检测进一步验证了基于深度学习的识别方法的可行性与高效性。
中图分类号:
[1]PENG Y A.A Technical Guide to Falling Interventions for the Elderly[J].Journal of Practical Rural Doctors,2012,19(8):1-13.(in Chinese)彭宇案.老年人跌倒干预技术指南[J].中国实用乡村医生杂志,2012,19(8):1-13. [2]SANNINO G,FALCO I DE,PIETRO G DE.A supervised approach to automatically extract a set of rules to support fall detection in an mHealth system[J].Applied Soft Computing,2015,34(C):205-216. [3]National Bureau of Statistics of the People’s Republic of China. Statistical Communique of the 2017 National Economic and Social Development of the People’s Republic of China[J].China Statistics,2018(3):7-20.(in Chinese)中国人民共和国国家统计局.中华人民共和国2017年国民经济和社会发展统计公报[J].中国统计,2018(3):7-20. [4]NOURY N,FLEURY A,RUMEAU P,et al.Fall Detection-principles and Methods//29th Annual International Conference of the IEEE on Engineering in Medicine and Biology Society.Lyon,France,2007:1663-1666. [5]MUBASHIR M,SHAO L,SEED L.A survey on fall detection:Principles and approaches[J].Neurocomputing,2013,100:144-152. [6]RATHI N,KAKANI M,EL-SHARKAWY M,et al.Wearablelow power pre-fall detection system with IoT and bluetooth capabilities[C]//IEEE National Aerospace and Electronics Conference (NAECON).Dayton,OH,2017:241-244. [7]HOSSAIN F,ALI M L,ISLAM M Z,et al.A direction-sensitive fall detection system using single 3D accelerometer and learning classifier[C]//International Conference on Medical Engineering,Health Informatics and Technology (MediTec).Dhaka,2016:1-6. [8]SCHWICKERT L,BECKER C,LINDEMANN U,et al.Fall detection with body-worn sensors?:a systematic review[J].Zeitschrift Für Gerontologie Und Geriatrie,2013,46(8):706-719. [9]YAZAR A,ÇETIN A E.Ambient assisted smart home designusing vibration and PIR sensors[C]//21st Signal Processing and Communications Applications Conference (SIU).Haspolat,2013:1-4. [10]ARSHAD A,KHAN S,ALAM A H M Z,et al.A capacitive proximity sensing scheme for human motion detection[C]//IEEE International Instrumentation and Measurement Techno-logy Conference(I2MTC).Turin,2017:1-5. [11]REN S,GIRSHICK R,GIRSHICK R,et al.Faster R-CNN:Towards Real-Time Object Detection with Region Proposal Networks[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2015,39(6):1137-1149. [12]REDMON J,DIVVALA S,GIRSHICK R,et al.You Only Look Once:Unified,Real-Time Object Detection[C]//IEEE Confer-ence on Computer Vision and Pattern Recognition (CVPR).Las Vegas,NV,2016:779-788. [13]LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single shotmultibox detector[J].arXiv:1512.02325v2,2015. [14]ZHOU X Y,WANG K,LI L Y.Review of object detection based on deep learning[J].Electronic Measurement Technology,2017(11):89-93.(in Chinese)周晓彦,王珂,李凌燕.基于深度学习的目标检测算法综述[J].电子测量技术,2017(11):89-93. [15]FU C,LIU W,RANGA A,et al.DSSD:Deconvolutional single shot detector[J].arXiv:1701.06659,2016. [16]JEONG J,PARK H,KWAK N.Enhancement of ssd by concatenating feature maps for object detection[J].arXiv:1705.09587,2017. [17]LI Z,ZHOU F.FSSD:Feature fusion single shot multibox detector[J].arXiv preprint arXiv:1712.00960,2017. [18]SHEN Z,LIU Z,LI J,et al.DSOD:Learning Deeply Supervised Object Detectors from Scratch//Proceedings of the IEEE International Conference on Computer Vision.2017:1937-1945. [19]ZHANG Z,CONLY C,ATHITSOS V.A survey on vision-based fall detection[C]//8th ACM International Conference on PErvasive Technologies Related to Assistive Environments.2015:1-7. [20]MITERAN J,DUBOIS J,ATRI M.Optimized spatio-temporal descriptors for real-time fall detection:comparison of support vector machine and Adaboost-based classification[J].Journal of Electronic Imaging,2013,22(4):41106. [21]YUN Y,INNOCENTI C,NERO G,et al.Fall detection in RGB-D videos for elderly care[C]//17th International Conference on E-health Networking.Boston,MA,2015:422-427. [22]LECUN Y,BENGIO Y,HINTON G.Deep learning[J].Nature,2015,521(7553):436. [23]ADHIKARI K,BOUCHACHIA H,NAIT-CHARIF H.Activity recognition for indoor fall detection using convolutional neural network[C]//Fifteenth IAPR International Conference on Machine Vision Applications.Nagoya,2017:81-84. [24]HUANG C D,WANG C Y,WANG J.Human action recognition system for elderly and children care using three stream ConvNet[C]//International Conference on Orange Technologies.Hong Kong,2016:5-9. [25]SIMONYAN K,ZISSERMAN A.Two-stream convolutionalnetworks for action recognition in videos[J].Advances in Neural Information Processing Systems,2014,1(4):568-576. [26]MIN W,CUI H,RAO H,et al.Detection of Human Falls on Furniture Using Scene Analysis Based on Deep Learning and Activity Characteristics[J].IEEE Access,2018,PP(99):1. [27]HE K,SUN J.Convolutional neural networks at constrainedtime cost[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).2015:5353-5360. [28]ROUGIER C,MEUNIER J,ST-ARNAUD A,et al.Robust Video Surveillance for Fall Detection Based on Human Shape Deformation.IEEE Transactions on Circuits and Systems for Video Technology,2011,21(5):611-622. [29]MIRMAHBOUB B,SAMAVI S,KARIMI N,et al.Automatic monocular system for human fall detection based on variations in silhouette area[J].IEEE Transactions on Biomedical Engineering,2013,60(2):427-436. |
[1] | 饶志双, 贾真, 张凡, 李天瑞. 基于Key-Value关联记忆网络的知识图谱问答方法 Key-Value Relational Memory Networks for Question Answering over Knowledge Graph 计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277 |
[2] | 汤凌韬, 王迪, 张鲁飞, 刘盛云. 基于安全多方计算和差分隐私的联邦学习方案 Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy 计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108 |
[3] | 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺. 时序知识图谱表示学习 Temporal Knowledge Graph Representation Learning 计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204 |
[4] | 王剑, 彭雨琦, 赵宇斐, 杨健. 基于深度学习的社交网络舆情信息抽取方法综述 Survey of Social Network Public Opinion Information Extraction Based on Deep Learning 计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099 |
[5] | 郝志荣, 陈龙, 黄嘉成. 面向文本分类的类别区分式通用对抗攻击方法 Class Discriminative Universal Adversarial Attack for Text Classification 计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077 |
[6] | 姜梦函, 李邵梅, 郑洪浩, 张建朋. 基于改进位置编码的谣言检测模型 Rumor Detection Model Based on Improved Position Embedding 计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046 |
[7] | 孙奇, 吉根林, 张杰. 基于非局部注意力生成对抗网络的视频异常事件检测方法 Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection 计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061 |
[8] | 胡艳羽, 赵龙, 董祥军. 一种用于癌症分类的两阶段深度特征选择提取算法 Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification 计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092 |
[9] | 程成, 降爱莲. 基于多路径特征提取的实时语义分割方法 Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction 计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157 |
[10] | 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木. 中文预训练模型研究进展 Advances in Chinese Pre-training Models 计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018 |
[11] | 周慧, 施皓晨, 屠要峰, 黄圣君. 基于主动采样的深度鲁棒神经网络学习 Robust Deep Neural Network Learning Based on Active Sampling 计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044 |
[12] | 苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫. 小样本雷达辐射源识别的深度学习方法综述 Survey of Deep Learning for Radar Emitter Identification Based on Small Sample 计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138 |
[13] | 刘伟业, 鲁慧民, 李玉鹏, 马宁. 指静脉识别技术研究综述 Survey on Finger Vein Recognition Research 计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056 |
[14] | 孙福权, 崔志清, 邹彭, 张琨. 基于多尺度特征的脑肿瘤分割算法 Brain Tumor Segmentation Algorithm Based on Multi-scale Features 计算机科学, 2022, 49(6A): 12-16. https://doi.org/10.11896/jsjkx.210700217 |
[15] | 康雁, 徐玉龙, 寇勇奇, 谢思宇, 杨学昆, 李浩. 基于Transformer和LSTM的药物相互作用预测 Drug-Drug Interaction Prediction Based on Transformer and LSTM 计算机科学, 2022, 49(6A): 17-21. https://doi.org/10.11896/jsjkx.210400150 |
|