Computer Science ›› 2021, Vol. 48 ›› Issue (5): 163-169.doi: 10.11896/jsjkx.200800214

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Detection of Head-bowing Abnormal Pedestrians Based on Human Joint Points

GUAN Wen-hua, LIN Chun-yu, YANG Shang-rong, LIU Mei-qin, ZHAO Yao   

  1. Institute of Information Science,Beijing Jiaotong University,Beijing 100044,China
  • Received:2020-08-31 Revised:2021-03-22 Online:2021-05-15 Published:2021-05-09
  • About author:GUAN Wen-hua,born in 1995,postgraduate.Her main research interests include multimedia information proces-sing and so on.(13051193368@163.com)
    LIN Chun-yu,born in 1979,Ph.D,professor.His main research interests include image and video processing,three-dimensional vision processing,vision-based assisted driving,etc.
  • Supported by:
    National Natural Science Foundation of China(61772066, 61972028) and Fundamental Research Funds for the Central Universities (2018JBZ001).

Abstract: In recent years,with the rapid development of smart phones,head-bowing pedestrians keep browsing mobile phones when they cross the road.As a result,they often cause the traffic accidents.How to effectively detect the bow-headed people has become an urgent problem.The existing detection methods not only require a large number of datasets about real pedestrians using mobile phones,but also have the problems of low recognition accuracy and unsatisfactory speed.Considering these problems,this paper proposes a fast and effective method to detect head-bowing abnormal pedestrians.This method is based on joint points instead of images,therefore it is different from existing methods.Firstly,we propose a novel method to construct a synthetic dataset,which solves the problem of lacking dataset and corresponding labels.We leverage human joint points by adjusting the coordinates of the left and right hand to simulate the posture of device-holding.Secondly,we achieve the abnormal behavior recognition and classification by training network on our synthetic dataset.Additionally,we make full use of arm and head information to achieve a precise pedestrian abnormal behavior detection.Finally,experiment results show that the proposed method can achieve real-time detection,and the detection accuracy reaches 94.08%.Therefore,it can provide necessary reference information for video surveillance,drivers,assisted driving,and autonomous driving systems.

Key words: Abnormal detection, Bowed heads detection, Data fitting, Human joint points

CLC Number: 

  • TP391
[1]ZHAO Y,LIU D,WANG J X.Study on the impact of pedes-trians crossing streets using mobile phones on traffic safety[J].Journal of Chinese People's Public Security University:Science and Technology,2015,21(2):58-62.
[2]ZHOU Y.Research of pedestrian abnormal behavior detectionmethod and implementation of the detection system [D].Nanjing:Southeast University,2016.
[3]HU H,JIANG S,LI Z,et al.Abnormal Pedestrian Crossing Detection Based on Video Processing[M]//ICCTP 2011:Towards Sustainable Transportation Systems.2011:1391-1400.
[4]WU X,OU Y,QIAN H,et al.A detection system for human abnormal behavior[C]//2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.IEEE,2005:1204-1208.
[5]LI Y,XU C,LIU J,et al.Detecting irregularity in videos using kernel estimation and kd trees[C]//Proceedings of the 14th ACM international conference on Multimedia.2006:639-642.
[6]SULTANI W,CHEN C,SHAH M.Real-world anomaly detection in surveillance videos[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:6479-6488.
[7]PARK S,PARK J,AL-MASNI M,et al.A depth camera-based human activity recognition via deep learning recurrent neural network for health and social care services[J].Procedia Computer Science,2016,100(100):78-84.
[8]LI J J,LIU C L,ZHU M.Fast Abnormal Pedestrians Detection Based on Multi-Task CNN in Surveillance Video[J].Computer Systems & Applications,2018,27(11):78-83.
[9]DONG Y R.Unconscious behavior detection for pedestrian safety [D].Beijing:Beijing Jiaotong University,2019.
[10]WEI S E,RAMAKRISHNA V,KANADE T,et al.Convolu-tional pose machines[C]//Proceedings of the IEEE conference on Computer Vision and Pattern Recognition.2016:4724-4732.
[11]NEWELL A,YANG K,DENG J.Stacked hourglass networksfor human pose estimation[C]//European Conference on Computer Vision.Springer,Cham,2016:483-499.
[12]FANG H S,XIE S,TAI Y W,et al.Rmpe:Regional multiperson pose estimation[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2334-2343.
[13]CAO Z,SIMON T,WEI S E,et al.Realtime multi-person 2dpose estimation using part affinity fields[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:7291-7299.
[14]NEWELL A,HUANG Z,DENG J.Associative embedding:End-to-end learning for joint detection and grouping[C]//Advances in Neural Information Processing Systems.2017:2277-2287.
[15]LIU Z,LUO P,QIU S,et al.Deepfashion:Powering robust clothes recognition and retrieval with rich annotations[C]//Pro-ceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1096-1104.
[16]DALAL N,TRIGGS B.Histograms of oriented gradients forhuman detection[C]//2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).IEEE,2005,1:886-893.
[17]ZHANG S,XIE Y,WAN J,et al.WiderPerson:A diverse dataset for dense pedestrian detection in the wild[J].IEEE Transactions on Multimedia,2020,22(2):380-393.
[18]DOLLÁR P,WOJEK C,SCHIELE B,et al.Pedestrian detec-tion:A benchmark[C]//2009 IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2009:304-311.
[19]CHEN X,MA H,WAN J,et al.Multi-view 3d object detection network for autonomous driving[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:1907-1915.
[1] LI Hai-wei,ZHANG Da-fang,LIU Jun,YANG Xiao-bo. Active Detecting Method against SYN Flooding Attacks [J]. Computer Science, 2010, 37(3): 117-120.
[2] LIANG Li XIAO, Fei GAO Song (School of Computer Science and Information Technology, Yunnan Normal University, Kunming 650092). [J]. Computer Science, 2007, 34(6): 294-294.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!