计算机科学 ›› 2020, Vol. 47 ›› Issue (4): 119-124.doi: 10.11896/jsjkx.190300392

• 计算机图形学&多媒体 • 上一篇    下一篇

一种用于异常行为检测的运动特征描述子

王昆仑, 刘文璨, 何小海, 卿粼波, 吴晓红   

  1. 四川大学电子信息学院 成都610065
  • 收稿日期:2019-03-01 出版日期:2020-04-15 发布日期:2020-04-15
  • 通讯作者: 何小海(nic5602@scu.edu.cn)
  • 基金资助:
    四川省科技计划项目(2018HH0143);国家自然科学基金(61871278);成都市产业集群协同创新项目(2016-XT00-00015-GX)

Motion Feature Descriptor for Abnormal Behavior Detection

WANG Kun-lun, LIU Wen-can, HE Xiao-hai, QING Lin-bo, WU Xiao-hong   

  1. School of Electronics and Information Engineering,Sichuan University,Chengdu 610065,China
  • Received:2019-03-01 Online:2020-04-15 Published:2020-04-15
  • Contact: HE Xiao-hai,born in 1964,Ph.D,professor,Ph.D supervisor.His main research interests include image processing,pattern recognition,computer vision,image communication,and software engineering.
  • About author:WANG Kun-lun,born in 1995,postgraduate.His main research interests include computer vision and pattern recognition.
  • Supported by:
    This work was supported by the Sichuan Science and Technology Program(2018HH0143),National Natural Science Foundation of China (61871278) and Chengdu Science and Technology Project (2016-XT00-00015-GX)

摘要: 目前,用于描述视频中人群的运动信息大多是基于光流的速度描述子。事实上,加速度蕴含丰富的运动信息,能够提供速度描述子在描述复杂运动模式时缺失的信息,以更好地表征复杂的运动模式。文中研究了一种运动特征描述子,使用受限玻尔兹曼机模型进行异常行为检测。首先,提取视频中的光流场信息,计算帧间加速度光流;然后,对一个时空块中的加速度信息进行直方图统计,将若干帧的所有时空块直方图特征进行拼接,从而获得加速度描述子;最后,在仅包含正常行为的训练集上建立受限玻尔兹曼机模型,在测试阶段根据测试视频重建特征与原始特征的误差大小进行异常检测。实验表明,所提出的加速度描述子结合速度描述子,在UMN数据集与UCF-Web数据集上,ROC曲线下的面积分别达到了0.984与0.958,相较于其他算法,所提方法取得了更高的异常行为检测准确率。

关键词: 加速度光流, 受限玻尔兹曼机, 特征提取, 异常行为, 运动信息特征

Abstract: Modern motion description techniques for crowd motion in videos are mostly velocity descriptors based on optical flow.However,acceleration contains a wealth of motion information,which can provide information that the velocity descriptors are missing when describing complex motion patterns,and can better characterize complex motion patterns.This paper studies a motion descriptor,which uses an energy-based restricted Boltzmann machine model to perform anomalous behavior detection.Firstly,the optical flow information in the video is extracted,and the acceleration information is calculated through the optical flow information of two consecutive frames.Then,acceleration histogram feature is computed over spatial-temporal blocks,and all the spatial-temporal block histogram features of adjacent frames are spliced to obtain an acceleration descriptor.The Restricted Boltzmann Machine learns the normal motion patterns from the normal video training set,which is used for abnormal detection in terms of the errors of reconstructed data in detecting phase.The results show that the average area under the curve (AUC) of the UMN dataset reaches 0.984,and the area under the average curve (AUC) of UCF-Web reaches 0.958.Compared with other state-of-the-art algorithms,the proposed descriptor has superior performance on anomaly detection.

Key words: Abnormal behavior, Acceleration optical flow, Feature extraction, Motion feature, Restricted boltzmann machine

中图分类号: 

  • TP391.41
[1]SODEMANN A A,ROSS M P,BORGHETTI B J.A review of anomaly detection in automated surveillance[J].IEEE Transactions on Systems,Man,and Cybernetics,Part C (Applications and Reviews),2012,42(6):1257-1272.
[2]ILG E,MAYER N,SAIKIA T,et al.Flownet 2.0:Evolution of optical flow estimation with deep networks[C]//IEEEConfe-rence on Computer Vision and Pattern Recognition.IEEE,2017:6.
[3]YANG Y,SOATTO S.Conditional Prior Networks for OpticalFlow[C]// European Conference on Computer Vision.Sprin-ger,2018:282-298.
[4]KLASER A,MARSZALEK M,SCHMID C.A spatio-temporaldescriptor based on 3d-gradients[C]//19th British Machine Vision Conference.British Machine Vision Association,2008:275:1-10.
[5]NISHINO K,KRATZ L.Anomaly detection in extremelycrowded scenes using spatio-temporal motion pattern models[C]//2009 IEEE Conference on Computer Vision and Pattern Recognition.Miami,IEEE,2009:1446-1453.
[6]LAPTEV I,MARSZALEK M,SCHMID C,et al.Learning realistic human actions from movies[C]//Computer Vision and Pattern Recognition.IEEE,2008:1-8.
[7]CONG Y,YUAN J,LIU J.Sparse reconstruction cost for abnormal event detection[C]//Computer Vision and Pattern Recognition.IEEE,2011:3449-3456.
[8]LI A,MIAO Z,CEN Y,et al.Abnormal event detection based on sparse reconstruction in crowded scenes[C]//Acoustics,Speech and Signal Processing (ICASSP).IEEE,2016:1786-1790.
[9]NALLAIVAROTHAYAN H,FOOKES C,DENMAN S,et al.An MRF based abnormal event detection approach using motion and appearance features[C]//Advanced Video and Signal Based Surveillance (AVSS).IEEE,2014:343-348.
[10]DIREKOGLU C,SAH M,O’CONNOR N E.Abnormal crowd behavior detection using novel optical flow-based features[C]//2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).IEEE,2017:1-6.
[11]EDISON A,JIJI C V.Optical Acceleration for Motion Description in Videos[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).Honolulu,2017:21-26.
[12]HINTON G E,SALAKHUTDINOV R R.Reducing the dimensionality of data with neural networks[J].Science,2006,313(5786):504-507.
[13]VU H,NGUYEN T D,TRAVERS A,et al.Energy-based localized anomaly detection in video surveillance[C]//Pacific-Asia Conference on Knowledge Discovery and Data Mining.Springer.Cham,2017:641-653.
[14]ACKLEY D H,HINTON G E,SEJNOWSKI T J.A learning algorithm for Boltzmann machines[J].Cognitive Science,1985,9(1):147-169.
[15]MEHRAN R,OYAMA A,SHAH M.Abnormal crowd behavior detection using social force model[C]//Computer Vision and Pattern Recognition.IEEE,2009:935-942.
[16]WANG T,QIAO M,DENG Y,et al.Abnormal event detection based on analysis of movement information of video sequence[J].Optik-International Journal for Light and Electron Optics,2018,152:50-60.
[17]SHI Y,GAO Y,WANG R.Real-time abnormal event detection in complicated scenes[C]//Pattern Recognition (ICPR).IEEE,2010:3653-3656.
[18]WANG T,SNOUSSI H.Detection of abnormal visual events via global optical flow orientation histogram[J].IEEE Transactions on Information Forensics and Security,2014,9(6):988-998.
[19]ZHU X,LIU J,WANG J,et al.Sparse representation for robust abnormality detection in crowded scenes[J].Pattern Recognition,2014,47(5):1791-1799.
[20]ZHU X,LIU J,WANG J,et al.Weighted interaction force estimation for abnormality detection in crowd scenes[C]//Asian Conference on Computer Vision.Springer,Berlin,Heidelberg,2012:507-518.
[21]CHEN H,GAI J,ZHANG S,et al.Abnormal event detection based on cosparse reconstruction[J].The Journal of Enginee-ring,2018,2018(5):254-256.
[1] 张源, 康乐, 宫朝辉, 张志鸿.
基于Bi-LSTM的期货市场关联交易行为检测方法
Related Transaction Behavior Detection in Futures Market Based on Bi-LSTM
计算机科学, 2022, 49(7): 31-39. https://doi.org/10.11896/jsjkx.210400304
[2] 曾志贤, 曹建军, 翁年凤, 蒋国权, 徐滨.
基于注意力机制的细粒度语义关联视频-文本跨模态实体分辨
Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism
计算机科学, 2022, 49(7): 106-112. https://doi.org/10.11896/jsjkx.210500224
[3] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[4] 刘伟业, 鲁慧民, 李玉鹏, 马宁.
指静脉识别技术研究综述
Survey on Finger Vein Recognition Research
计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056
[5] 高元浩, 罗晓清, 张战成.
基于特征分离的红外与可见光图像融合算法
Infrared and Visible Image Fusion Based on Feature Separation
计算机科学, 2022, 49(5): 58-63. https://doi.org/10.11896/jsjkx.210200148
[6] 张红民, 李萍萍, 房晓冰, 刘宏.
改进YOLOv3网络模型的人体异常行为检测方法
Human Abnormal Behavior Detection Method Based on Improved YOLOv3 Network Model
计算机科学, 2022, 49(4): 233-238. https://doi.org/10.11896/jsjkx.210300251
[7] 左杰格, 柳晓鸣, 蔡兵.
基于图像分块与特征融合的户外图像天气识别
Outdoor Image Weather Recognition Based on Image Blocks and Feature Fusion
计算机科学, 2022, 49(3): 197-203. https://doi.org/10.11896/jsjkx.201200263
[8] 任首朋, 李劲, 王静茹, 岳昆.
基于集成回归决策树的lncRNA-疾病关联预测方法
Ensemble Regression Decision Trees-based lncRNA-disease Association Prediction
计算机科学, 2022, 49(2): 265-271. https://doi.org/10.11896/jsjkx.201100132
[9] 徐涛, 田崇阳, 刘才华.
基于深度学习的人群异常行为检测综述
Deep Learning for Abnormal Crowd Behavior Detection:A Review
计算机科学, 2021, 48(9): 125-134. https://doi.org/10.11896/jsjkx.201100015
[10] 张师鹏, 李永忠.
基于降噪自编码器和三支决策的入侵检测方法
Intrusion Detection Method Based on Denoising Autoencoder and Three-way Decisions
计算机科学, 2021, 48(9): 345-351. https://doi.org/10.11896/jsjkx.200500059
[11] 冯霞, 胡志毅, 刘才华.
跨模态检索研究进展综述
Survey of Research Progress on Cross-modal Retrieval
计算机科学, 2021, 48(8): 13-23. https://doi.org/10.11896/jsjkx.200800165
[12] 张丽倩, 李孟航, 高珊珊, 张彩明.
面向计算机辅助舌诊关键问题的解决方案综述
Summary of Computer-assisted Tongue Diagnosis Solutions for Key Problems
计算机科学, 2021, 48(7): 256-269. https://doi.org/10.11896/jsjkx.200800223
[13] 暴雨轩, 芦天亮, 杜彦辉, 石达.
基于i_ResNet34模型和数据增强的深度伪造视频检测方法
Deepfake Videos Detection Method Based on i_ResNet34 Model and Data Augmentation
计算机科学, 2021, 48(7): 77-85. https://doi.org/10.11896/jsjkx.210300258
[14] 霍帅, 庞春江.
基于Transformer和多通道卷积神经网络的情感分析研究
Research on Sentiment Analysis Based on Transformer and Multi-channel Convolutional Neural Network
计算机科学, 2021, 48(6A): 349-356. https://doi.org/10.11896/jsjkx.200800004
[15] 李娜娜, 王勇, 周林, 邹春明, 田英杰, 郭乃网.
基于特征重要度二次筛选的DDoS攻击随机森林检测方法
DDoS Attack Random Forest Detection Method Based on Secondary Screening of Feature Importance
计算机科学, 2021, 48(6A): 464-467. https://doi.org/10.11896/jsjkx.200900101
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!