计算机科学 ›› 2021, Vol. 48 ›› Issue (5): 163-169.doi: 10.11896/jsjkx.200800214

• 计算机图形学&多媒体 • 上一篇    下一篇

基于人体关节点的低头异常行人检测

管文华, 林春雨, 杨尚蓉, 刘美琴, 赵耀   

  1. 北京交通大学信息科学研究所 北京100044
  • 收稿日期:2020-08-31 修回日期:2021-03-22 出版日期:2021-05-15 发布日期:2021-05-09
  • 通讯作者: 林春雨(cylin@bjtu.edu.cn)
  • 基金资助:
    国家自然科学基金(61772066, 61972028);中央高校基本科研业务费(2018JBZ001)

Detection of Head-bowing Abnormal Pedestrians Based on Human Joint Points

GUAN Wen-hua, LIN Chun-yu, YANG Shang-rong, LIU Mei-qin, ZHAO Yao   

  1. Institute of Information Science,Beijing Jiaotong University,Beijing 100044,China
  • Received:2020-08-31 Revised:2021-03-22 Online:2021-05-15 Published:2021-05-09
  • About author:GUAN Wen-hua,born in 1995,postgraduate.Her main research interests include multimedia information proces-sing and so on.(13051193368@163.com)
    LIN Chun-yu,born in 1979,Ph.D,professor.His main research interests include image and video processing,three-dimensional vision processing,vision-based assisted driving,etc.
  • Supported by:
    National Natural Science Foundation of China(61772066, 61972028) and Fundamental Research Funds for the Central Universities (2018JBZ001).

摘要: 近年来,随着智能手机的快速发展,低头族行人在过马路时依然保持浏览手机的姿态,由此造成的交通事故时有发生。如何有效检测低头族成为了当下亟待解决的问题。现有的检测方法需要大量的真实低头异常的数据集,且最终结果存在识别精度不高、速度不尽人意的问题。基于此,提出了一种快速有效的低头异常行人检测方法,与现有方法的区别在于该方法是基于关节点而不是图像。首先设计了一种构造数据集的方法,在识别人体关节点的基础上,调整左右腕关节坐标来模拟行人手持电子设备的姿态,解决了数据集缺少且需要大量标注的问题;其次,提出复杂环境中高效检测行人异常行为的算法,对上述关节点坐标进行分类识别,充分利用手臂与头部信息来实现行人异常行为检测。实验证明,所提算法能够实现实时检测,且检测精度达到了94.08%,从而可以为视频监控、驾驶员、辅助驾驶以及自动驾驶系统提供必要的参考信息。

关键词: 低头检测, 人体关节点, 数据拟合, 异常检测

Abstract: In recent years,with the rapid development of smart phones,head-bowing pedestrians keep browsing mobile phones when they cross the road.As a result,they often cause the traffic accidents.How to effectively detect the bow-headed people has become an urgent problem.The existing detection methods not only require a large number of datasets about real pedestrians using mobile phones,but also have the problems of low recognition accuracy and unsatisfactory speed.Considering these problems,this paper proposes a fast and effective method to detect head-bowing abnormal pedestrians.This method is based on joint points instead of images,therefore it is different from existing methods.Firstly,we propose a novel method to construct a synthetic dataset,which solves the problem of lacking dataset and corresponding labels.We leverage human joint points by adjusting the coordinates of the left and right hand to simulate the posture of device-holding.Secondly,we achieve the abnormal behavior recognition and classification by training network on our synthetic dataset.Additionally,we make full use of arm and head information to achieve a precise pedestrian abnormal behavior detection.Finally,experiment results show that the proposed method can achieve real-time detection,and the detection accuracy reaches 94.08%.Therefore,it can provide necessary reference information for video surveillance,drivers,assisted driving,and autonomous driving systems.

Key words: Abnormal detection, Bowed heads detection, Data fitting, Human joint points

中图分类号: 

  • TP391
[1]ZHAO Y,LIU D,WANG J X.Study on the impact of pedes-trians crossing streets using mobile phones on traffic safety[J].Journal of Chinese People's Public Security University:Science and Technology,2015,21(2):58-62.
[2]ZHOU Y.Research of pedestrian abnormal behavior detectionmethod and implementation of the detection system [D].Nanjing:Southeast University,2016.
[3]HU H,JIANG S,LI Z,et al.Abnormal Pedestrian Crossing Detection Based on Video Processing[M]//ICCTP 2011:Towards Sustainable Transportation Systems.2011:1391-1400.
[4]WU X,OU Y,QIAN H,et al.A detection system for human abnormal behavior[C]//2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.IEEE,2005:1204-1208.
[5]LI Y,XU C,LIU J,et al.Detecting irregularity in videos using kernel estimation and kd trees[C]//Proceedings of the 14th ACM international conference on Multimedia.2006:639-642.
[6]SULTANI W,CHEN C,SHAH M.Real-world anomaly detection in surveillance videos[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:6479-6488.
[7]PARK S,PARK J,AL-MASNI M,et al.A depth camera-based human activity recognition via deep learning recurrent neural network for health and social care services[J].Procedia Computer Science,2016,100(100):78-84.
[8]LI J J,LIU C L,ZHU M.Fast Abnormal Pedestrians Detection Based on Multi-Task CNN in Surveillance Video[J].Computer Systems & Applications,2018,27(11):78-83.
[9]DONG Y R.Unconscious behavior detection for pedestrian safety [D].Beijing:Beijing Jiaotong University,2019.
[10]WEI S E,RAMAKRISHNA V,KANADE T,et al.Convolu-tional pose machines[C]//Proceedings of the IEEE conference on Computer Vision and Pattern Recognition.2016:4724-4732.
[11]NEWELL A,YANG K,DENG J.Stacked hourglass networksfor human pose estimation[C]//European Conference on Computer Vision.Springer,Cham,2016:483-499.
[12]FANG H S,XIE S,TAI Y W,et al.Rmpe:Regional multiperson pose estimation[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2334-2343.
[13]CAO Z,SIMON T,WEI S E,et al.Realtime multi-person 2dpose estimation using part affinity fields[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:7291-7299.
[14]NEWELL A,HUANG Z,DENG J.Associative embedding:End-to-end learning for joint detection and grouping[C]//Advances in Neural Information Processing Systems.2017:2277-2287.
[15]LIU Z,LUO P,QIU S,et al.Deepfashion:Powering robust clothes recognition and retrieval with rich annotations[C]//Pro-ceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1096-1104.
[16]DALAL N,TRIGGS B.Histograms of oriented gradients forhuman detection[C]//2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).IEEE,2005,1:886-893.
[17]ZHANG S,XIE Y,WAN J,et al.WiderPerson:A diverse dataset for dense pedestrian detection in the wild[J].IEEE Transactions on Multimedia,2020,22(2):380-393.
[18]DOLLÁR P,WOJEK C,SCHIELE B,et al.Pedestrian detec-tion:A benchmark[C]//2009 IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2009:304-311.
[19]CHEN X,MA H,WAN J,et al.Multi-view 3d object detection network for autonomous driving[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:1907-1915.
[1] 徐天慧, 郭强, 张彩明.
基于全变分比分隔距离的时序数据异常检测
Time Series Data Anomaly Detection Based on Total Variation Ratio Separation Distance
计算机科学, 2022, 49(9): 101-110. https://doi.org/10.11896/jsjkx.210600174
[2] 李其烨, 邢红杰.
基于最大相关熵的KPCA异常检测方法
KPCA Based Novelty Detection Method Using Maximum Correntropy Criterion
计算机科学, 2022, 49(8): 267-272. https://doi.org/10.11896/jsjkx.210700175
[3] 王馨彤, 王璇, 孙知信.
基于多尺度记忆残差网络的网络流量异常检测模型
Network Traffic Anomaly Detection Method Based on Multi-scale Memory Residual Network
计算机科学, 2022, 49(8): 314-322. https://doi.org/10.11896/jsjkx.220200011
[4] 杜航原, 李铎, 王文剑.
一种面向电商网络的异常用户检测方法
Method for Abnormal Users Detection Oriented to E-commerce Network
计算机科学, 2022, 49(7): 170-178. https://doi.org/10.11896/jsjkx.210600092
[5] 武玉坤, 李伟, 倪敏雅, 许志骋.
单类支持向量机融合深度自编码器的异常检测模型
Anomaly Detection Model Based on One-class Support Vector Machine Fused Deep Auto-encoder
计算机科学, 2022, 49(3): 144-151. https://doi.org/10.11896/jsjkx.210100142
[6] 冷佳旭, 谭明圮, 胡波, 高新波.
基于隐式视角转换的视频异常检测
Video Anomaly Detection Based on Implicit View Transformation
计算机科学, 2022, 49(2): 142-148. https://doi.org/10.11896/jsjkx.210900266
[7] 刘意, 毛莺池, 程杨堃, 高建, 王龙宝.
基于邻域一致性的异常检测序列集成方法
Locality and Consistency Based Sequential Ensemble Method for Outlier Detection
计算机科学, 2022, 49(1): 146-152. https://doi.org/10.11896/jsjkx.201000156
[8] 张叶, 李志华, 王长杰.
基于核密度估计的轻量级物联网异常流量检测方法
Kernel Density Estimation-based Lightweight IoT Anomaly Traffic Detection Method
计算机科学, 2021, 48(9): 337-344. https://doi.org/10.11896/jsjkx.200600108
[9] 郭奕杉, 刘漫丹.
基于时空轨迹数据的异常检测
Anomaly Detection Based on Spatial-temporal Trajectory Data
计算机科学, 2021, 48(6A): 213-219. https://doi.org/10.11896/jsjkx.201100193
[10] 邢红杰, 郝忠.
基于全局和局部判别对抗自编码器的异常检测方法
Novelty Detection Method Based on Global and Local Discriminative Adversarial Autoencoder
计算机科学, 2021, 48(6): 202-209. https://doi.org/10.11896/jsjkx.200400083
[11] 刘立成, 徐一凡, 谢贵才, 段磊.
面向NoSQL数据库的JSON文档异常检测与语义消歧模型
Outlier Detection and Semantic Disambiguation of JSON Document for NoSQL Database
计算机科学, 2021, 48(2): 93-99. https://doi.org/10.11896/jsjkx.200900039
[12] 邹承明, 陈德.
高维大数据分析的无监督异常检测方法
Unsupervised Anomaly Detection Method for High-dimensional Big Data Analysis
计算机科学, 2021, 48(2): 121-127. https://doi.org/10.11896/jsjkx.191100141
[13] 石琳姗, 马创, 杨云, 靳敏.
基于SSC-BP神经网络的异常检测算法
Anomaly Detection Algorithm Based on SSC-BP Neural Network
计算机科学, 2021, 48(12): 357-363. https://doi.org/10.11896/jsjkx.201000086
[14] 杨月麟, 毕宗泽.
基于深度学习的网络流量异常检测
Network Anomaly Detection Based on Deep Learning
计算机科学, 2021, 48(11A): 540-546. https://doi.org/10.11896/jsjkx.201200077
[15] 冯安然, 王旭仁, 汪秋云, 熊梦博.
基于PCA和随机树的数据库异常访问检测
Database Anomaly Access Detection Based on Principal Component Analysis and Random Tree
计算机科学, 2020, 47(9): 94-98. https://doi.org/10.11896/jsjkx.190800056
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!