Computer Science ›› 2023, Vol. 50 ›› Issue (12): 212-220.doi: 10.11896/jsjkx.221000183

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Continuous Dense Normalized Flow Model for Anomaly Detection in Industrial Images

ZHANG Zouquan1, ZHANG Hui2, WU Tianyue1, CHEN Tiancai3   

  1. 1 School of Electrical & Information Engineering,Changsha University of Science and Technology,Changsha 410000,China
    2 School of Robotics,Hunan University,Changsha 410000,China
    3 School of Electrical & Information Engineering,Hunan University,Changsha 410000,China
  • Received:2022-10-23 Revised:2023-03-17 Online:2023-12-15 Published:2023-12-07
  • About author:ZHANG Zouquan,born in 1998,master.His main research interests include image processing,deep learning and so on.
    ZHANG Hui,born in 1983,Ph.D,professor.His main research interests include machine vision and sparse representation.
  • Supported by:
    National Key R & D Program of China(2021ZD0114503),National Natural Science Foundation of China(61971071,62027810),National Science Fund for Distinguished Young Scholars of Hunan Province,China(2021JJ10025) and Postgraduate Scientific Research Innovation Project of Hunan Province(CX20210797).

Abstract: Anomaly detection on the surface of industrial products is an indispensable link in manufacturing.In actual industrial production,there are common phenomena such as low proportion of abnormal samples and complex and changeable unknown abnormal,which in turn cause a series of negative effects such as overfitting and poor generalization ability on few-shot datasets.In recent years,the idea of normalized flow has brought a new approach to the field of industrial image anomaly detection based on deep learning,but the inherent architecture of normalized flow easily leads to insufficient model expressiveness.Aiming at the above difficulties,a continuous dense normalized flow model for industrial image anomaly detection is proposed.First,a feature extraction network pre-training strategy based on contrastive learning is designed,which involves simulated abnormal data and a small amount of real abnormal data in the contrastive learning task,and trains the feature backbone network AlexNet to narrow or widen the distance between specific samples.Secondly,a continuous dense normalized flow model is designed,and it uses a composite architecture of reversible transformation to construct a dense flow module to enhance the fitting ability of the generative model to the distribution.The experimental datasets include MVTec AD,Magnetic Tile Defects and self-made industrial cloth datasets.Compared with other anomaly detection models,our method achieves optimal or sub-optimal detection performance on the three datasets,respectively.

Key words: Industrial image detection, Anomaly detection, Deep learning, Normalized flow, Contrastive learning

CLC Number: 

  • TP391
[1]CHALAPATHY R,CHAWLA S.Deep Learning for AnomalyDetection:A Survey[EB/OL].(2019-01-23)[2022-10-10].https://arxiv.org/pdf/1901.03407.pdf.
[2]LV C K,SHEN F,ZHANG Z T,et al.Review of Image Ano-maly Detection[J].Acta Automatica Sinica,2022,48(6):1402-1428.
[3]BERGMANN P,FAUSER M,SATTLEGGER D,et al.MVTec AD-A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Long Beach:IEEE Press,2019:9592-9600.
[4]HUANG Y,QIU C,YUAN K.Surface Defect Saliency of Magnetic Tile[J].The Visual Computer,2020,36(1):85-96.
[5]XU T,TIAN C Y,LIU C H.Deep Learning for AbnormalCrowd Behavior Detection:A Review[J].Computer Science,2021,48(9):125-134.
[6]WANG Y S,YAO H X,SUN X S,et al.Representation Ability Research of Autoencoders in Deep Learning[J].Computer Science,2015,42(9):56-60,65.
[7]BERGMANN P,LÖWE S,FAUSER M,et al.Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoders[EB/OL].(2019-02-01)[2022-10-10].https://arxiv.org/pdf/1807.02011.pdf.
[8]YU W Y,ZHANG Y,YAO H M,et al.Visual Inspection ofSurface Defects Based on Lightweight Reconstruction Network[J].Acta Automatica Sinica,2022,48(9):2175-2186.
[9]ZAVRTANIK V,KRISTAN M,SKOČAJ D.DRAEM:A Discriminatively Trained Reconstruction Embedding for Surface Anomaly Detection[C]//Proceedings of the IEEE International Conference on Computer Vision.Montreal:IEEE Press,2021:8330-8339.
[10]KIM D,JEONG D,KIM H,et al.Spatial Contrastive Learning for Anomaly Detection and Localization[J].IEEE Access,2022,10:17366-17376.
[11]LI C L,SOHN K,YOON J,et al.Cutpaste:Self-SupervisedLearning for Anomaly Detection and Localization[C]//Procee-dings of the IEEE Conference on Computer Vision and Pattern Recognition.Nashville:IEEE Press,2021:9664-9674.
[12]ULGER F,YUKSELS E,YILMAZ A.Anomaly Detection forSolder Joints using β-VAE[J].IEEE Transactions on Components,Packaging and Manufacturing Technology,2021,11(12):2214-2221.
[13]SCHLEGL T,SEEBÖCK P,WALDSTEIN S M,et al.Unsupervised Anomaly Detection withGenerative Adversarial Networks to Guide Marker Discovery[C]//International Conference on Information Processing in Medical Imaging.Springer,2017:146-157.
[14]XING H J,HAO Z.Novelty Detection Method Based on Global and Local Discriminative Adversarial Autoencoder[J].Compu-ter Science,2021,48(6):202-209.
[15]KOBYZEV I,PRINCE S J D,BRUBAKER M A.NormalizingFlows:An Introduction and Review of Current Methods[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,43(11):3964-3979.
[16]DINH L,KRUEGER D,BENGIO Y.NICE:Non-Linear Independent Components Estimation[EB/OL].(2015-04-10)[2022-10-10].https://arxiv.org/pdf/1410.8516.pdf.
[17]HUANG C W,DINH L,COURVILLE A.Augmented Normalizing Flows:Bridging the Gap between Generative Flows and Latent Variable Models[EB/OL].(2020-02-17)[2022-10-10].https://arxiv.org/pdf/2002.07101.pdf.
[18]RUDOLPH M,WANDT B,ROSENHAHN B.Same Same but Differnet:Semi-Supervised Defect Detection with Normalizing Flows[C]//Proceedings of the IEEE Winter Conference on Applications of Computer Vision.Waikoloa:IEEE Press,2021:1907-1916.
[19]CIMPOI M,MAJI S,KOKKINOS I,et al.Describing Textures in the Wild[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Columbus:IEEE Press,2014:3606-3613.
[20]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImagenetClassification with Deep Convolutional Neural Networks[J].Communications of the ACM,2017,60(6):84-90.
[21]KRUSE J,DETOMMASO G,KÖTHE U,et al.HINT:Hierarchical Invertible Neural Transport for Density Estimation and Bayesian Inference[C]//Proceedings of the 35th AAAI Confe-rence on Artificial Intelligence.2021:8191-8199.
[22]DINH L,SOHL-DICKSTEIN J,BENGIO S.Density Estimation using Real NVP[EB/OL].(2017-02-27)[2022-07-08].https://arxiv.org/pdf/1605.08803.pdf.
[23]DEFARD T,SETKOV A,LOESCH A,et al.Padim:A Patch Distribution Modeling Framework for Anomaly Detection and Localization[C]//International Conference on Pattern Recognition.Springer,2021:475-489.
[24]AKCAY S,ATAPOUR-ABARGHOUEI A,BRECKON T P.Ganomaly:Semi-Supervised Anomaly Detection via Adversarial Training[C]//Asian Conference on Computer Vision.Springer,2018:622-637.
[25]PANG G,DING C,SHEN C.Explainable Deep Few-Shot Ano-maly Detection with Deviation Networks[EB/OL].(2021-08-01)[2022-10-10].https://arxiv.org/pdf/2108.00462.pdf.
[26]DING C,PANG G,SHEN C.Catching Both Gray and BlackSwans:Open-Set Supervised Anomaly Detection[C]//Procee-dings of the IEEE Conference on Computer Vision and Pattern Recognition.2022:7388-7398.
[27]VENKATARAMANAN S,PENG K C,SINGH R V,et al.Attention Guided Anomaly Localization in Images[C]//European Conference on Computer Vision.2020:485-503.
[1] ZHAO Mingmin, YANG Qiuhui, HONG Mei, CAI Chuang. Smart Contract Fuzzing Based on Deep Learning and Information Feedback [J]. Computer Science, 2023, 50(9): 117-122.
[2] XU Jie, WANG Lisong. Contrastive Clustering with Consistent Structural Relations [J]. Computer Science, 2023, 50(9): 123-129.
[3] LI Haiming, ZHU Zhiheng, LIU Lei, GUO Chenkai. Multi-task Graph-embedding Deep Prediction Model for Mobile App Rating Recommendation [J]. Computer Science, 2023, 50(9): 160-167.
[4] HUANG Hanqiang, XING Yunbing, SHEN Jianfei, FAN Feiyi. Sign Language Animation Splicing Model Based on LpTransformer Network [J]. Computer Science, 2023, 50(9): 184-191.
[5] HU Shen, QIAN Yuhua, WANG Jieting, LI Feijiang, LYU Wei. Super Multi-class Deep Image Clustering Model Based on Contrastive Learning [J]. Computer Science, 2023, 50(9): 192-201.
[6] LI Xiang, FAN Zhiguang, LIN Nan, CAO Yangjie, LI Xuexiang. Self-supervised Learning for 3D Real-scenes Question Answering [J]. Computer Science, 2023, 50(9): 220-226.
[7] ZHU Ye, HAO Yingguang, WANG Hongyu. Deep Learning Based Salient Object Detection in Infrared Video [J]. Computer Science, 2023, 50(9): 227-234.
[8] ZHANG Yian, YANG Ying, REN Gang, WANG Gang. Study on Multimodal Online Reviews Helpfulness Prediction Based on Attention Mechanism [J]. Computer Science, 2023, 50(8): 37-44.
[9] SONG Xinyang, YAN Zhiyuan, SUN Muyi, DAI Linlin, LI Qi, SUN Zhenan. Review of Talking Face Generation [J]. Computer Science, 2023, 50(8): 68-78.
[10] WANG Xu, WU Yanxia, ZHANG Xue, HONG Ruize, LI Guangsheng. Survey of Rotating Object Detection Research in Computer Vision [J]. Computer Science, 2023, 50(8): 79-92.
[11] ZHOU Ziyi, XIONG Hailing. Image Captioning Optimization Strategy Based on Deep Learning [J]. Computer Science, 2023, 50(8): 99-110.
[12] ZHANG Xiao, DONG Hongbin. Lightweight Multi-view Stereo Integrating Coarse Cost Volume and Bilateral Grid [J]. Computer Science, 2023, 50(8): 125-132.
[13] WANG Yu, WANG Zuchao, PAN Rui. Survey of DGA Domain Name Detection Based on Character Feature [J]. Computer Science, 2023, 50(8): 251-259.
[14] WANG Mingxia, XIONG Yun. Disease Diagnosis Prediction Algorithm Based on Contrastive Learning [J]. Computer Science, 2023, 50(7): 46-52.
[15] LI Hui, LI Wengen, GUAN Jihong. Dually Encoded Semi-supervised Anomaly Detection [J]. Computer Science, 2023, 50(7): 53-59.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!