Computer Science ›› 2019, Vol. 46 ›› Issue (6): 305-310.doi: 10.11896/j.issn.1002-137X.2019.06.046

Previous Articles     Next Articles

Crowd Behavior Recognition Algorithm Based on Combined Features and Deep Learning

YUAN Ya-jun, LEE Fei-fei, CHEN Qiu   

  1. (School of Optical-Electrical and Computer Engineering,University of Shanghai for Science and Technology,Shanghai 200093,China)
  • Received:2018-05-12 Published:2019-06-24

Abstract: The target of analyzing crowd behavior is to better analyze and manage the state and tendency of crowd movement.This paper proposed a novel deep learning based crowd behavior recognition method by using two types of crowd behavior features.Firstly,the crowd is regarded as the main object,a foreground extraction method is used to extract the static information of crowd,and the dynamic information of crowd is obtained by the change of the crowd movement.Then two different crowd behavior characteristics are learned by using convolution neural network (CNN) model,so as to analyze crowd behaviors in the end.Additionally,the extraction location and interval of crowd data are crucial factors in the crowd behavior recognition.Experimental results show that two crowd characteristics can better describe crowd states on the spatial dimension and crowd changes on the temporal dimension.The rational data location and data interval can effectively improve the expression ability of crowd information.At last,this method was compared with other crowd behavior recognition algorithms.The quantitative and qualitative experimental results demonstrate the validity of the proposed method.Besides,better confusion matrix and higher precision can be obtained by this method.

Key words: CNN, Crowd behavior recognition, Data extraction, Dynamic characteristic, Static characteristic

CLC Number: 

  • TP391
[1]SHAO J,KANG K,CHEN C L,et al.Deeply learned attributes for crowded scene understanding[C]∥International Conference on Computer Vision and Pattern Recognition.2015:4657-4666.
[2]PALANISAMY G,MANIKANDAN T T.Group Behaviour Profiling for Detection of Anomaly in Crowd[C]∥International Conference on Technical Advancements in Computers and Communications.2017:11-15.
[3]RODRIGUES F,LOURENCO M,RIBEIRO B,et al.Learning Supervised Topic Models for Classification and Regression from Crowds[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,PP(99):1-1.
[4]YI S,LI H,WANG X.Pedestrian Behavior Modeling from Stationary Crowds with Applications to Intelligent Surveillance[J].IEEE Transactions on Image Processing,2016,25(9):4354-4368.
[5]SENGUPTA S,WANG H,BLACKBURN W,et al.Spatial information in classification of activity videos[C]∥2015 Federated Conference on Computer Science and Information Systems.2015:145-153.
[6]SHAO J,CHEN C L,WANG X.Learning Scene-Independent Group Descriptors for Crowd Understanding[J].IEEE Transactions on Circuits & Systems for Video Technology,2017,27(6):1290-1303.
[7]ZHANG C,KANG K,LI H,et al.Data-Driven Crowd Understanding:A Baseline for a Large-Scale Crowd Dataset[J].IEEE Transactions on Multimedia,2016,18(6):1048-1061.
[8]JI S,YANG M,YU K.3D convolutional neural networks for human action recognition [J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2013,35(1):221-231.
[9]SIMONYAN K,ZISSERMAN A.Two-Stream Convolutional Networks for Action Recognition in Videos[J].Advances in Neural Information Processing Systems,2014,1(4):568-576.
[10]SHAO J,CHEN C L,KANG K,et al.Slicing Convolutional Neural Network for Crowd Video Understanding[C]∥International Conference Conference on Computer Vision and Pattern Recognition.2016:5620-5628.
[11]JING S,CHEN C L,KAI K,et al.Crowded Scene Understan-ding by Deeply Learned Volumetric Slices[J].IEEE Transactions on Circuits & Systems for Video Technology,2017,27(3):613-623.
[12]KARPATHY A,TODERICI G,SHETTY S,et al.Large-Scale Video Classification with Convolutional Neural Networks[C]∥International Conference Computer Vision and Pattern Recognition.2014:1725-1732.
[13]SHAO J,LOY C C,WANG X.Scene-Independent Group Profiling in Crowd[C]∥International Conference on Computer Vision and Pattern Recognition.2014:2227-2234.
[14]BURNEY A,SYED T Q.Crowd Video Classification Using Convolutional Neural Networks[C]∥International Conference on Frontiers of Information Technology.2017:1255-1259.
[15]YI S,WANG X.Profiling stationary crowd groups[C]∥International Conference on Multimedia and Expo.2014:1-6.
[16]YI S,LI H,WANG X.Understanding pedestrian behaviors from stationary crowd groups[C]∥International Conference on Computer Vision and Pattern Recognition.2015:3488-3496.
[17]SENST T,EISELEIN V,SIKORA T.A local feature based on lagrangian measures for violent video classification[C]∥International Conference on Imaging for Crime Prevention and Detection.2015:1-6.
[18]FEICHTENHOFER C,PINZ A,ZISSERMAN A.Convolutional Two-Stream Network Fusion for Video Action Recognition[C]∥International Conference on Computer Vision and PatternRe-cognition.2016:1933-1941.
[19]GOMEZ-DONOSO F,GARCIA-GARCIA A,GARCIA-RO-DRIGUEZ J,et al.LonchaNet:A sliced-based CNN architecture for real-time 3D object recognition[C]∥International Joint Conference on Neural Networks.2017:412-418.
[20]MARSDEN M,MCGUINNESS K,LITTLE S,et al.Fully Convolutional Crowd Counting On Highly Congested Scenes[J].arXiv preprint arXiv:1612.00220.
[21]SHI Y,TIAN Y,WANG Y,et al.Sequential Deep Trajectory Descriptor for Action Recognition with Three-Stream CNN[J].IEEE Transactions on Multimedia,2017,19(7):1510-1520.
[1] JIN Fang-yan, WANG Xiu-li. Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM [J]. Computer Science, 2022, 49(7): 179-186.
[2] YUE Qing, YIN Jian-yu, WANG Sheng-sheng. Automatic Detection of Pulmonary Nodules in Low-dose CT Images Based on Improved CNN [J]. Computer Science, 2022, 49(6A): 54-59.
[3] YU Ben-gong, ZHANG Zi-wei, WANG Hui-ling. TS-AC-EWM Online Product Ranking Method Based on Multi-level Emotion and Topic Information [J]. Computer Science, 2022, 49(6A): 165-171.
[4] ZHU Wen-tao, LAN Xian-chao, LUO Huan-lin, YUE Bing, WANG Yang. Remote Sensing Aircraft Target Detection Based on Improved Faster R-CNN [J]. Computer Science, 2022, 49(6A): 378-383.
[5] WANG Shan, XU Chu-yi, SHI Chun-xiang, ZHANG Ying. Study on Cloud Classification Method of Satellite Cloud Images Based on CNN-LSTM [J]. Computer Science, 2022, 49(6A): 675-679.
[6] ZHAO Zheng-peng, LI Jun-gang, PU Yuan-yuan. Low-light Image Enhancement Based on Retinex Theory by Convolutional Neural Network [J]. Computer Science, 2022, 49(6): 199-209.
[7] HUANG Xiao-sheng, XU Jing. Multi-focus Image Fusion Method Based on PCANet in NSST Domain [J]. Computer Science, 2021, 48(9): 181-186.
[8] XING Hao, LI Ming. Deepfake Video Detection Based on 3D Convolutional Neural Networks [J]. Computer Science, 2021, 48(7): 86-92.
[9] CUI Wen-hao, JIANG Mu-rong, YANG Lei, FU Peng-ming, ZHU Ling-xiao. Combining MCycleGAN and RFCNN to Realize High Resolution Reconstruction of Solar Speckle Image [J]. Computer Science, 2021, 48(6A): 38-42.
[10] LIU Han-qing, KANG Xiao-dong, LI Bo, ZHANG Hua-li, FENG Ji-chao, HAN Jun-ling. Comparative Study on Classification and Recognition of Medical Images Using Deep Learning Network [J]. Computer Science, 2021, 48(6A): 89-94.
[11] YU Jian-ye, QI Yong, WANG Bao-zhuo. Distributed Combination Deep Learning Intrusion Detection Method for Internet of Vehicles Based on Spark [J]. Computer Science, 2021, 48(6A): 518-523.
[12] ZHONG Yue, FANG Hu-sheng, ZHANG Guo-yu, WANG Zhao, ZHU Jing-wei. Method of CNN Flag Movement Recognition Based on 9-axis Attitude Sensor [J]. Computer Science, 2021, 48(6): 153-158.
[13] SHU Xin, CHANG Feng, ZHANG Xin, DU Rui, YU Zhuan. Transverse Section Recognition Algorithm Based on BCNN for Fetal Craniocerebral Ultrasound [J]. Computer Science, 2021, 48(4): 151-156.
[14] QI Yan-rong, ZHOU Xia-bing, LI Bin, ZHOU Qing-lei. FPGA-based CNN Image Recognition Acceleration and Optimization [J]. Computer Science, 2021, 48(4): 205-212.
[15] LI Bing-rong, PI De-chang, HOU Meng-ru. Destination Prediction of Moving Objects Based on Convolutional Neural Networks and Long-Short Term Memory [J]. Computer Science, 2021, 48(4): 70-77.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!