Computer Science ›› 2018, Vol. 45 ›› Issue (8): 236-241.doi: 10.11896/j.issn.1002-137X.2018.08.042

• Graphics, Image & Pattern Recognition • Previous Articles     Next Articles

Unbalanced Crowd Density Estimation Based on Convolutional Features

QU Jia, SHI Zeng-lin, YE Yang-dong   

  1. School of Information Engineering,Zhengzhou University,Zhengzhou 450001,China
  • Received:2017-06-28 Online:2018-08-29 Published:2018-08-29

Abstract: Crowd density estimation plays a central role in intelligent monitoring.Deep neural network usually outperforms conventional approaches based on manual features owing to its data-driven superiority.However,deep neural networks are still far from optimal solution because of the scarceness of large-scale datasets.To address this problem,this paper investigated the feasibility of several solutions which are training shallow neural network from scratch,using fullyconnected layer features of pretrained deep neural network and aggregating convolutional features by way of fisher vector(FV).Aiming at the problem of unbalanced distribution,this paper further proposed several classification evaluation criteria.Comprehensive experiments were carried out on benchmark PETs2009 dataset.Results show that convolutional features outperform existing hand-crafted ones.Moreover,utilizing deep convolutional features based on transfer learning usually leads to better performance than the models trained from scratch.Finally,simpler pretrained models such as AlexNet can generalize better mobility of the lower layer features than more complicated ones such as VGGNet.

Key words: Crowd density estimation, Deep convolutional neural network, SVM, Texture feature, Transfer learning

CLC Number: 

  • TP391.4
[1]YANG H,SU H,ZHENG S,et al.The large-scale crowd density estimation based on sparse spatiotemporal local binary pattern[C]∥Proceedings of IEEE International Conference on Multimedia and Expo.IEEE,2011:1-6.
[2]FRADI H,ZHAO X,DUGELAY J L.Crowd density analysisusing subspace learning on local binary pattern[C]∥IEEE International Conference on Multimedia and Expo Workshops.IEEE,2013:1-6.
[3]DAVIES A C,YIN J H,VELASTIN S A.Crowd monitoring using image processing[J].Electronics & Communication Engineering Journal,1995,7(1):37-47.
[4]XU L Q,ANJULAN A.Crowd behaviours analysis in dynamic visual scenes of complex environment[C]∥IEEE International Conference on Image Processing.IEEE,2008:9-12.
[5]WU X,LIANG G,LEE K K,et al.Crowd density estimationusing texture analysis and learning[C]∥IEEE International Conference on Robotics and Biomimetics.IEEE,2006:214-219.
[6]MA W,HUANG L,LIU C.Crowd density analysis using co-occurrence texture features[C]∥International Conference on Computer Sciences and Convergence Information Technology.IEEE,2010:170-175.
[7]MA W,HUANG L,LIU C.Advanced local binary pattern descriptors for crowd estimation[C]∥IEEE International Confe-rence on Computational Intelligence and Industrial Application Pacific-Asia Workshop.IEEE,2008:958-962.
[8]WANG Z,LIU H,QIAN Y,et al.Crowd density estimationbased on local binary pattern co-occurrence matrix[C]∥IEEE International Conference on Multimedia and Expo Workshops.IEEE,2012:372-377.
[9]MARANA A N,VERONA V V.Wavelet packet analysis for crowd density estimation[OL].
[10]MARANA A N,VELASTIN S A,COSTA L F,et al.Estimation of crowd density using image processing[C]∥Proceedings of IEEE Colloquium on Image Processing for Security Applications.1997:11/1-11/8.
[11]HINTON G E,SALAKHUTDINOV R R.Reducing the dimensionality of data with neural networks[J].Science,2006,313(5786):504-507.
[12]BENGIO Y,COURVILLE A,VINCENT P.Representationlearning:A review and new perspectives[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(8):1798-1828.
[13]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks[C]∥Proceedings of Advances in Neural Information Processing Systems Nevada.USA:NIPS,2012:1097-1105.
[14]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv preprint arXiv:1409.1556,2014.
[15]SZEGEDY C,LIU W,JIA Y,et al.Going deeper with convolutions[C]∥IEEE Conference on Computer Vision and Pattern Recognition.2015:1-9.
[16]ZHOU Y,CHEUNG N M.Vehicle Classification using Transferable Deep Neural Network Features[J].arXiv preprint ar-Xiv:1601.01145,2016.
[17]SARKAR S,PATEL V M,CHELLAPPA R.Deep feature-based face detection on mobile devices[C]∥IEEE International Conference on Identity,Security and Behavior Analysis.IEEE,2016:1-8.
[18]CIMPOI M,MAJI S,VEDALDI A.Deep filter banks for texture recognition and segmentation[C]∥IEEE Conference on Computer Vision and Pattern Recognition.2015:3828-3836.
[19]KANDASWAMY K K,CHOU K C,MARTINETZ T,et al.AFP-Pred:A random forest approach for predicting antifreeze proteins from sequence-derived properties[J].Journal of Theoretical Biology,2011,270(1):56-62.
[20]LECUN Y,BOTTOU L,BENGIO Y,et al.Gradient-basedlearning applied to document recognition[J].Proceedings of the IEEE,1998,86(11):2278-2324.
[21]POLUS A,SCHOFER J L,USHPIZ A.Pedestrian flow and le-vel of service[J].Journal of Transportation Engineering,1983,109(1):46-56.
[22]ZEILER M D,FERGUS R.Visualizing and understanding con-volutional networks[C]∥European Conference on Computer Vision.Zurich,Switzerland:Springer,2014:818-833.
[23]YOSINSKI J,CLUNE J,BENGIO Y,et al.How transferable are features in deep neural networks?[C]∥Proceedings of Advances in Neural Information Processing Systems.2014:3320-3328.
[24]VEDALDI A,LENC K.MatConvNet:Convolutional NeuralNetworks for MATLAB[C]∥Proceedings of ACM Internatio-nal Conference on Multimedia.ACM,2015:689-692.
[1] FANG Yi-qiu, ZHANG Zhen-kun, GE Jun-wei. Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning [J]. Computer Science, 2022, 49(8): 70-77.
[2] LIU Wei-ming, AN Ran, MAO Yi-min. Parallel Support Vector Machine Algorithm Based on Clustering and WOA [J]. Computer Science, 2022, 49(7): 64-72.
[3] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[4] WANG Jun-feng, LIU Fan, YANG Sai, LYU Tan-yue, CHEN Zhi-yu, XU Feng. Dam Crack Detection Based on Multi-source Transfer Learning [J]. Computer Science, 2022, 49(6A): 319-324.
[5] HU Cong, HE Xiao-hui, SHAO Fa-ming, ZHANG Yan-wu, LU Guan-lin, WANG Jin-kang. Traffic Sign Detection Based on MSERs and SVM [J]. Computer Science, 2022, 49(6A): 325-330.
[6] ZHOU Zhi-hao, CHEN Lei, WU Xiang, QIU Dong-liang, LIANG Guang-sheng, ZENG Fan-qiao. SMOTE-SDSAE-SVM Based Vehicle CAN Bus Intrusion Detection Algorithm [J]. Computer Science, 2022, 49(6A): 562-570.
[7] PENG Yun-cong, QIN Xiao-lin, ZHANG Li-ge, GU Yong-xiang. Survey on Few-shot Learning Algorithms for Image Classification [J]. Computer Science, 2022, 49(5): 1-9.
[8] HU Fu-yuan, WAN Xin-jun, SHEN Ming-fei, XU Jiang-lang, YAO Rui, TAO Zhong-ben. Survey Progress on Image Instance Segmentation Methods of Deep Convolutional Neural Network [J]. Computer Science, 2022, 49(5): 10-24.
[9] TAN Zhen-qiong, JIANG Wen-Jun, YUM Yen-na-cherry, ZHANG Ji, YUM Peter-tak-shing, LI Xiao-hong. Personalized Learning Task Assignment Based on Bipartite Graph [J]. Computer Science, 2022, 49(4): 269-281.
[10] WU Yu-kun, LI Wei, NI Min-ya, XU Zhi-cheng. Anomaly Detection Model Based on One-class Support Vector Machine Fused Deep Auto-encoder [J]. Computer Science, 2022, 49(3): 144-151.
[11] ZUO Jie-ge, LIU Xiao-ming, CAI Bing. Outdoor Image Weather Recognition Based on Image Blocks and Feature Fusion [J]. Computer Science, 2022, 49(3): 197-203.
[12] ZHANG Shu-meng, YU Zeng, LI Tian-rui. Transferable Emotion Analysis Method for Cross-domain Text [J]. Computer Science, 2022, 49(3): 218-224.
[13] HOU Chun-ping, ZHAO Chun-yue, WANG Zhi-peng. Video Abnormal Event Detection Algorithm Based on Self-feedback Optimal Subclass Mining [J]. Computer Science, 2021, 48(7): 199-205.
[14] XIN Yuan-xue, SHI Peng-fei, XUE Rui-yang. Moving Object Detection Based on Region Extraction and Improved LBP Features [J]. Computer Science, 2021, 48(7): 233-237.
[15] CHENG Song-sheng, PAN Jin-shan. Video Super-resolution Method Based on Deep Learning Feature Warping [J]. Computer Science, 2021, 48(7): 184-189.
Full text



No Suggested Reading articles found!