Computer Science ›› 2023, Vol. 50 ›› Issue (6A): 211200205-7.doi: 10.11896/jsjkx.211200205

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Motion Contrast Enhancement-based Crowd Motion Segmentation Method

ZHANG Xinfeng, NI Qili, CHEN Shuhan, YANG Baoqing, LI Bin   

  1. College of Information Engineering(College of Artificial Intelligence),Yanzhou University,Yangzhou,Jiangsu 225127,China
  • Online:2023-06-10 Published:2023-06-12
  • About author:ZHANG Xinfeng,born in 1984,Ph.D,lecturer.His main research interests include visual computing and collaborative perception.
  • Supported by:
    National Natural Science Foundation of China(61801417,61802336) and Natural Science Foundation of the Jiangsu Higher Education Institutions of China(18KJB520051).

Abstract: In surveillance videos of public places,the movement states of the crowds are various and complex,and it is difficult to analyze the movement state of the whole crowd through detecting or segmenting every individual.Therefore,it is an effective way to understand and analyze the movement state of the crowd by dividing the crowd into areas with basically the same movement state.Supervised crowd motion segmentation methods require pixel-level training sets with high labeling costs,and thus unsupervised clustering methods are more promising for crowd motion segmentation.However,since the local features describing crowd movements usually change gradually,leading to the unsupervised methods based on clustering algorithm need to choose different parameters for different crowd scenarios,it is difficult to adapt to a variety of different application scenarios.To this end,this paper proposes a motion contrast improvement-based crowd motion segmentation method.The method is an unsupervised model that first enhances the contrast of different motion states based on the distribution law of movement and noise in the motion field,and then combines the adaptive threshold segmentation algorithm and the marker watershed algorithm to extract the essentially consistent region for each motion state,avoiding the difficulty of parameter selection for unsupervised clustering methods.Based on the results of crowd motion segmentation,this paper presents an energy model to describe the stability of crowd movement.The energy model can enable early warning of abnormal crowd motion state by deducing the change process of the whole crowd motion state.Experiments are conducted on crowd motion segmentation in different types of complex crowd motion state scenes.Experimental results verify the effectiveness and segmentation accuracy of the motion contrast enhancement-based crowd motion segmentation method and the validity of the proposed energy model.

Key words: Crowd motion analysis, Motion contrast enhancement, Crowd motion segmentation, Energy model, Abnormal warning

CLC Number: 

  • TP37
[1]ZENG Z M,WANG J.Research about Emergency Intelligence Information Service from the Social Computing Perspective[J].Journal of Intelligence,2017,36(11):59-64,77.
[2]SHARMA R,GUHA T.A trajectory clustering approach tocrowd flow segmentation in videos[C]//IEEE International Conference on Image Processing.IEEE,2016.
[3]CHEN M,WANG C S,HAO D H.Pedestrian Detection Algorithm Based on SSD Multi-modal and Multi-scale Feature Fusion[J].Journal of Jinling Institute of Technology,2021,37(2):33-38.
[4]LI J J,YANG H,WU S.Crowd semantic segmentation based on spatial-temporal dynamics[C]//2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance(AVSS).IEEE,2016.
[5]CHENG Y.Research on Crowd Segmentation Based on Rein-forcement Learning[D].Shanghai:Shanghai Jiao Tong University,2020.
[6]YU H,PAN G,ZHANG L,et al.Translation domain segmentation model based on improved cosine similarity for crowd motion segmentation[J].Journal of Electronic Imaging,2019,28(2):1.
[7]ZHANG X F,NI Q L,CHEN S H,et al.A Crowd Flow Segmentation Method based on Deep Motion Transformation Network[C]//2021 6th International Conference on Multimedia and Image Processing(ICMIP 2021).Zhuhai,China,2021:8-10.
[8]ZHANG L,HE Z W,GU M Y,et al.Crowd SegmentationMethod Based on Trajectory Tracking and Prior Knowledge Learning[J].Arabian Journal for Science & Engineering,2018,43:7143-7152.
[9]GE W,COLLINS R T,RUBACK R B.Vision-Based Analysis of Small Groups in Pedestrian Crowds[M].IEEE Computer Society,2012.
[10]JODOIN P M,BENEZETH Y,WANG Y.Meta-Tracking forVideo Scene Understanding[C]//2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.IEEE,2013.
[11]RODRIGUEZ M,SIVIC J,LAPTEV L,et al.Data-driven crowdanalysis in videos[C]//2011 International Conference on Computer Vision.2011.
[12]NI Q L.Research on crowd flow segmentation method in complex scene and its application in crowd motion description[D].Yangzhou University,2021.
[13]ZHOU B,TANG X,WANG X.Coherent Filtering:Detecting Coherent Motions from Crowd Clutters[J].Springer Berlin Heidelberg,2012.
[14]PRAVEEN R G,BABU R V.Crowd flow segmentation based on motion vectors in H.264 compressed domain[C]//IEEE International Conference on Electronics.IEEE,2014.
[15]SUN D Q,YANG X D,LIU M Y,et al.PWC-Net:CNNs for Optical Flow Using Pyramid,Warping,and Cost Volume[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:8934-8943.
[16]CAO Y Q,WU D,HUANG X S.Track Defect Image Classification Based on Improved Ant Colony Algorithm[J].Computer Science,2019,46(8):292-297.
[17]GUO H R,SHAO W,ZHOU A W,et al.Novel defect recognition method based on adaptive global threshold for highlight metal surface[J].Chinese Journal of Scientific Instrument,2017,38(11):2797-2804.
[18]YU W S,HOU Z Q,SONG J J.Color Image SegmentationBased on Marked-Watershed and Region-Merger[J].Acta Electronica Sinica,2011,39(5):1007-1012.
[19]HAN J X.Applicable conditions of the law of conservation of momentum[J].Journal of Shenyang University(Social Science),2001,3(B12):211-212.
[20]WANG Z X.Law of conservation of energy[J].Physics Bulletin,1951(3):11-15.
[21]CHEN T,YING Z G,SHEN S F,et al.Evacuation simulation and analysis of social force model under the influence of relative speed[J].Progress in Natural Science,2006,16(12):1606-1612.
[22]WU H Q,XIE W H.Teaching of the First Law of Thermodynamics and the Second Law of Thermodynamics[J].The Guide of Science & Education,2015(4):80-81.
[23]ZHOU B L,TANG X O,ZHANG H P,et al.Measuring Crowd Collectiveness[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2014,36(8):1586-1599.
[24]SHAO J,LOY C C,WANG X G.Scene-Independent Group Profiling in Crowd[C]//Computer Vision and Pattern Recognition.IEEE,2014.
[1] LI Zhang-wei, XIAO Lu-qian, HAO Xiao-hu, ZHOU Xiao-gen, ZHANG Gui-jun. Multimodal Optimization Algorithm for Protein Conformation Space [J]. Computer Science, 2020, 47(7): 161-165.
[2] ZHOU Xiao-long, JIANG Jia-qi, LIN Jia-ning, CHEN Sheng-yong. Iris Center Localization Method Based on 3D Eyeball Model and Snakuscule [J]. Computer Science, 2019, 46(9): 284-290.
[3] YANG De-xian, SUN Hua, YU Jiong and GUO Bing-lei. Relational Database Energy Prediction Model Based on MBRC [J]. Computer Science, 2017, 44(7): 161-166.
[4] DONG Hui, HAO Xiao-hu and ZHANG Gui-jun. Local Enhancement Differential Evolution Searching Method for Protein Conformational Space [J]. Computer Science, 2015, 42(Z11): 22-26.
[5] HAO Xiao-hu, ZHANG Gui-jun, ZHOU Xiao-gen, CHENG Zheng-hua and ZHANG Qi-peng. Protein Conformational Space Optimization Algorithm Based on Fragment-assembly [J]. Computer Science, 2015, 42(3): 237-240.
[6] . Energy Optimization and Modeling in Wireless Sensor Networks ; A Survey [J]. Computer Science, 2012, 39(10): 15-20.
[7] XIAO De-qin,WANG Jing-li,LUO Xi-wen. Communication Energy Model for Large Scale Fields Sensor Networks [J]. Computer Science, 2009, 36(8): 75-78.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!