计算机科学 ›› 2020, Vol. 47 ›› Issue (4): 119-124.doi: 10.11896/jsjkx.190300392
王昆仑, 刘文璨, 何小海, 卿粼波, 吴晓红
WANG Kun-lun, LIU Wen-can, HE Xiao-hai, QING Lin-bo, WU Xiao-hong
摘要: 目前,用于描述视频中人群的运动信息大多是基于光流的速度描述子。事实上,加速度蕴含丰富的运动信息,能够提供速度描述子在描述复杂运动模式时缺失的信息,以更好地表征复杂的运动模式。文中研究了一种运动特征描述子,使用受限玻尔兹曼机模型进行异常行为检测。首先,提取视频中的光流场信息,计算帧间加速度光流;然后,对一个时空块中的加速度信息进行直方图统计,将若干帧的所有时空块直方图特征进行拼接,从而获得加速度描述子;最后,在仅包含正常行为的训练集上建立受限玻尔兹曼机模型,在测试阶段根据测试视频重建特征与原始特征的误差大小进行异常检测。实验表明,所提出的加速度描述子结合速度描述子,在UMN数据集与UCF-Web数据集上,ROC曲线下的面积分别达到了0.984与0.958,相较于其他算法,所提方法取得了更高的异常行为检测准确率。
中图分类号:
[1]SODEMANN A A,ROSS M P,BORGHETTI B J.A review of anomaly detection in automated surveillance[J].IEEE Transactions on Systems,Man,and Cybernetics,Part C (Applications and Reviews),2012,42(6):1257-1272. [2]ILG E,MAYER N,SAIKIA T,et al.Flownet 2.0:Evolution of optical flow estimation with deep networks[C]//IEEEConfe-rence on Computer Vision and Pattern Recognition.IEEE,2017:6. [3]YANG Y,SOATTO S.Conditional Prior Networks for OpticalFlow[C]// European Conference on Computer Vision.Sprin-ger,2018:282-298. [4]KLASER A,MARSZALEK M,SCHMID C.A spatio-temporaldescriptor based on 3d-gradients[C]//19th British Machine Vision Conference.British Machine Vision Association,2008:275:1-10. [5]NISHINO K,KRATZ L.Anomaly detection in extremelycrowded scenes using spatio-temporal motion pattern models[C]//2009 IEEE Conference on Computer Vision and Pattern Recognition.Miami,IEEE,2009:1446-1453. [6]LAPTEV I,MARSZALEK M,SCHMID C,et al.Learning realistic human actions from movies[C]//Computer Vision and Pattern Recognition.IEEE,2008:1-8. [7]CONG Y,YUAN J,LIU J.Sparse reconstruction cost for abnormal event detection[C]//Computer Vision and Pattern Recognition.IEEE,2011:3449-3456. [8]LI A,MIAO Z,CEN Y,et al.Abnormal event detection based on sparse reconstruction in crowded scenes[C]//Acoustics,Speech and Signal Processing (ICASSP).IEEE,2016:1786-1790. [9]NALLAIVAROTHAYAN H,FOOKES C,DENMAN S,et al.An MRF based abnormal event detection approach using motion and appearance features[C]//Advanced Video and Signal Based Surveillance (AVSS).IEEE,2014:343-348. [10]DIREKOGLU C,SAH M,O’CONNOR N E.Abnormal crowd behavior detection using novel optical flow-based features[C]//2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).IEEE,2017:1-6. [11]EDISON A,JIJI C V.Optical Acceleration for Motion Description in Videos[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).Honolulu,2017:21-26. [12]HINTON G E,SALAKHUTDINOV R R.Reducing the dimensionality of data with neural networks[J].Science,2006,313(5786):504-507. [13]VU H,NGUYEN T D,TRAVERS A,et al.Energy-based localized anomaly detection in video surveillance[C]//Pacific-Asia Conference on Knowledge Discovery and Data Mining.Springer.Cham,2017:641-653. [14]ACKLEY D H,HINTON G E,SEJNOWSKI T J.A learning algorithm for Boltzmann machines[J].Cognitive Science,1985,9(1):147-169. [15]MEHRAN R,OYAMA A,SHAH M.Abnormal crowd behavior detection using social force model[C]//Computer Vision and Pattern Recognition.IEEE,2009:935-942. [16]WANG T,QIAO M,DENG Y,et al.Abnormal event detection based on analysis of movement information of video sequence[J].Optik-International Journal for Light and Electron Optics,2018,152:50-60. [17]SHI Y,GAO Y,WANG R.Real-time abnormal event detection in complicated scenes[C]//Pattern Recognition (ICPR).IEEE,2010:3653-3656. [18]WANG T,SNOUSSI H.Detection of abnormal visual events via global optical flow orientation histogram[J].IEEE Transactions on Information Forensics and Security,2014,9(6):988-998. [19]ZHU X,LIU J,WANG J,et al.Sparse representation for robust abnormality detection in crowded scenes[J].Pattern Recognition,2014,47(5):1791-1799. [20]ZHU X,LIU J,WANG J,et al.Weighted interaction force estimation for abnormality detection in crowd scenes[C]//Asian Conference on Computer Vision.Springer,Berlin,Heidelberg,2012:507-518. [21]CHEN H,GAI J,ZHANG S,et al.Abnormal event detection based on cosparse reconstruction[J].The Journal of Enginee-ring,2018,2018(5):254-256. |
[1] | 张源, 康乐, 宫朝辉, 张志鸿. 基于Bi-LSTM的期货市场关联交易行为检测方法 Related Transaction Behavior Detection in Futures Market Based on Bi-LSTM 计算机科学, 2022, 49(7): 31-39. https://doi.org/10.11896/jsjkx.210400304 |
[2] | 曾志贤, 曹建军, 翁年凤, 蒋国权, 徐滨. 基于注意力机制的细粒度语义关联视频-文本跨模态实体分辨 Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism 计算机科学, 2022, 49(7): 106-112. https://doi.org/10.11896/jsjkx.210500224 |
[3] | 程成, 降爱莲. 基于多路径特征提取的实时语义分割方法 Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction 计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157 |
[4] | 刘伟业, 鲁慧民, 李玉鹏, 马宁. 指静脉识别技术研究综述 Survey on Finger Vein Recognition Research 计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056 |
[5] | 高元浩, 罗晓清, 张战成. 基于特征分离的红外与可见光图像融合算法 Infrared and Visible Image Fusion Based on Feature Separation 计算机科学, 2022, 49(5): 58-63. https://doi.org/10.11896/jsjkx.210200148 |
[6] | 张红民, 李萍萍, 房晓冰, 刘宏. 改进YOLOv3网络模型的人体异常行为检测方法 Human Abnormal Behavior Detection Method Based on Improved YOLOv3 Network Model 计算机科学, 2022, 49(4): 233-238. https://doi.org/10.11896/jsjkx.210300251 |
[7] | 左杰格, 柳晓鸣, 蔡兵. 基于图像分块与特征融合的户外图像天气识别 Outdoor Image Weather Recognition Based on Image Blocks and Feature Fusion 计算机科学, 2022, 49(3): 197-203. https://doi.org/10.11896/jsjkx.201200263 |
[8] | 任首朋, 李劲, 王静茹, 岳昆. 基于集成回归决策树的lncRNA-疾病关联预测方法 Ensemble Regression Decision Trees-based lncRNA-disease Association Prediction 计算机科学, 2022, 49(2): 265-271. https://doi.org/10.11896/jsjkx.201100132 |
[9] | 徐涛, 田崇阳, 刘才华. 基于深度学习的人群异常行为检测综述 Deep Learning for Abnormal Crowd Behavior Detection:A Review 计算机科学, 2021, 48(9): 125-134. https://doi.org/10.11896/jsjkx.201100015 |
[10] | 张师鹏, 李永忠. 基于降噪自编码器和三支决策的入侵检测方法 Intrusion Detection Method Based on Denoising Autoencoder and Three-way Decisions 计算机科学, 2021, 48(9): 345-351. https://doi.org/10.11896/jsjkx.200500059 |
[11] | 冯霞, 胡志毅, 刘才华. 跨模态检索研究进展综述 Survey of Research Progress on Cross-modal Retrieval 计算机科学, 2021, 48(8): 13-23. https://doi.org/10.11896/jsjkx.200800165 |
[12] | 张丽倩, 李孟航, 高珊珊, 张彩明. 面向计算机辅助舌诊关键问题的解决方案综述 Summary of Computer-assisted Tongue Diagnosis Solutions for Key Problems 计算机科学, 2021, 48(7): 256-269. https://doi.org/10.11896/jsjkx.200800223 |
[13] | 暴雨轩, 芦天亮, 杜彦辉, 石达. 基于i_ResNet34模型和数据增强的深度伪造视频检测方法 Deepfake Videos Detection Method Based on i_ResNet34 Model and Data Augmentation 计算机科学, 2021, 48(7): 77-85. https://doi.org/10.11896/jsjkx.210300258 |
[14] | 霍帅, 庞春江. 基于Transformer和多通道卷积神经网络的情感分析研究 Research on Sentiment Analysis Based on Transformer and Multi-channel Convolutional Neural Network 计算机科学, 2021, 48(6A): 349-356. https://doi.org/10.11896/jsjkx.200800004 |
[15] | 李娜娜, 王勇, 周林, 邹春明, 田英杰, 郭乃网. 基于特征重要度二次筛选的DDoS攻击随机森林检测方法 DDoS Attack Random Forest Detection Method Based on Secondary Screening of Feature Importance 计算机科学, 2021, 48(6A): 464-467. https://doi.org/10.11896/jsjkx.200900101 |
|