Computer Science ›› 2020, Vol. 47 ›› Issue (2): 118-125.doi: 10.11896/jsjkx.190100141

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Detection Method of Chip Surface Weak Defect Based on Convolution Denoising Auto-encoders

LUO Yue-tong,BIAN Jing-shuai,ZHANG Meng,RAO Yong-ming,YAN Feng   

  1. (School of Computer Science and Information Engineering,Hefei University of Technology,Hefei 230601,China)
  • Received:2019-01-17 Online:2020-02-15 Published:2020-03-18
  • About author:LUO Yue-tong,born in 1978,Ph.D,professor,master supervisor,is member of China Computer Federation (CCF).His main research interests include visual analytic,computer vision and automated optical inspection.
  • Supported by:
    This work was supported by the National Key Research and Development Plan of China (2017YFB1402200), Strengthen Police with Science and Technology Project of Anhui, China (1604d0802009), State Key Laboratory of CAD& CG, Zhejiang University (A1814), Fundamental Research Funds for the Central Universities of Ministry of Education of China (JZ2017HGBH0915) and Provincial Quality Engineering Project of the Higher Education Institutions of Anhui Province, China (2017jyxm0045).

Abstract: Chip surface defects can affect the appearance and performance of the chip.Therefore,surface defect detection is an important part of the chip production process.The automatic detection method based on machine vision attracts much attention because of its advantages of low cost and high efficiency.Weak defects such as low contrast between defects and background and small defects,bring challenges to traditional detection methods.Because deep learning has shown strong capabilities in the fields of machine vision in recent years,this paper studied the detection of weak defects on the chip surface by using the method based on deep learning.Chip surface defects were regarded as noise in this menthod.Firstly,convolutional denoising auto-encoders (CDAE) is applied to reconstruct the image without defect.Then,the reconstructed image without defect is used to subtract the input image,thus obtaining the residual image with defect information.Because the influence of background has been eliminated from the residual diagram,it is easier to detect defects based on the residual diagram.Because of the random noise in the process of reconstructing defect-free image from chip background image based on CDAE,the weak defect may be lost in the reconstructed noise.Therefore,this paper proposed an overlapping block strategy to suppress the reconstructed noise,so as to better detect the weak defect.Because CDAE is an unsupervised learning network,there is no need to perform a large amount of manual data annotation during training,which further enhances the applicability of the method.By using the real chip surface data provided by the paper partner,the effectiveness of the proposed method in chip surface detection is verified.

Key words: Chip surface defects, Convolution denoising auto-encoders, Deep learning, Defect detection, Unsupervised learning

CLC Number: 

  • TP391
[1]CHEN K.Research on key techniques for integrated circuit chip surface defects vision detection[D].Nanjing:Southeast University,2016.
[2]RADOVAN S,PAPADOPOULOS G D,GEORGOUDAKIS M,et al.Vision system for finished fabric inspection[C]∥Machine Vision Applications in Industrial Inspection X.San Jose,California:International Society for Optics and Photonics,2002:97-104.
[3]SILVÉN O,NISKANEN M,KAUPPINEN H.Wood inspection with non-supervised clustering[J].Machine Vision and Applications,2003,13(5/6):275-285.
[4]SINGHKA D K H,NEOGI N,MOHANTA D.Surface defect classification of steel strip based on machine vision[C]∥2014 International Conference on Computer and Communications Technologies (ICCCT).Hyderabad,India:IEEE,2014:1-5.
[5]CHIOU Y C,LIN C S,CHIOU B C.The feature extraction and analysis of flaw detection and classification in BGA gold-plating areas[J].Expert Systems with Applications,2008,35(4):1771-1779.
[6]DONG X F,HAN Z Y,LIAO S Y,et al.Study on Semiconductor Surface Defect Detection Based on Machine Vision[J].Metrology & Measurement Technology,2014,34(5):22-24,49.
[7]SU L,SHI T,DU L,et al.Genetic algorithms for defect detection of flip chips[J].Microelectronics Reliability,2015,55(1):213-220.
[8]FENG L,GONG Z H.An algorithm for chip surface defect detection based on sequential similarity and light source automatic adjustment[J].Modern Electronics Technique,2017(5):58-62.
[9]BENGIO Y,LECUN Y.Scaling learning algorithms towards AI[C]∥Large-Scale Kernel Machines.Hayward Street,Cambridge:MIT Press,2007:321-359.
[10]BENGIO Y,DELALLEAU O.On the expressive power of deep architectures[C]∥International Conference on Algorithmic Learning Theory.Germany:Springer-Verlag,2011:18-36.
[11]HINTON G E,SALAKHUTDINOV R R.Reducing the dimensionality of data with neural networks[J].Science,2006,313(5786):504-507.
[12]FENG C,LIU M Y,KAO C C,et al.Deep Active Learning for Civil Infrastructure Defect Detection and Classification[M]∥Computing in Civil Engineering 2017.Berlin:Springer,2017:298-306.
[13]ZHANG A,WANG K C P,LI B,et al.Automated pixel-level pavement crack detection on 3D asphalt surfaces using a deep-learning network[J].Computer-Aided Civil and Infrastructure Engineering,2017,32(10):805-819.
[14]REN R,HUNG T,TAN K C.A generic deep-learning-based approach for automated surface inspection[J].IEEE transactions on cybernetics,2018,48(3):929-940.
[15]WANG X B,LI J,YAO H M,et al.Solar Cells Surface Defects Detection Based on Deep Learning[J].Pattern Recognition and Artificial Intelligence,2014,27(6):517-523.
[16]LI Y,ZHAO W,PAN J.Deformable patterned fabric defect detection with Fisher criterion-based deep learning[J].IEEE Transactions on Automation Science and Engineering,2017,14(2):1256-1264.
[17]MEI S,YANG H,YIN Z.An unsupervised-learning-based approach for automated defect inspection on textured surfaces[J].IEEE Transactions on Instrumentation and Measurement,2018,67(6):1266-1277.
[18]VINCENT P,LAROCHELLE H,BENGIO Y,et al.Extracting and composing robust features with denoising autoencoders[C]∥Proceedings of the 25th International Conference on Machine Learning.New York:ACM,2008:1096-1103.
[19]VINCENT P,LAROCHELLE H,LAJOIE I,et al.Stacked denoising autoencoders:Learning useful representations in a deep network with a local denoising criterion[J].Journal of machine learning research,2010,11(12):3371-3408.
[20]PATHAK D,KRAHENBUHL P,DONAHUE J,et al.Context encoders:Feature learning by inpainting[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas,USA:IEEE,2016:2536-2544.
[21]STRUB F,MARY J,GAUDEL R.Hybrid Collaborative filtering with autoencoders[J].arXiv:1603.00806,2016.
[22]OTSU N.A threshold selection method from gray-level histograms[J].IEEE Transactions on Systems,Man,and Cyberneti-cs,1979,9(1):62-66.
[1] SONG Jie, LIANG Mei-yu, XUE Zhe, DU Jun-ping, KOU Fei-fei. Scientific Paper Heterogeneous Graph Node Representation Learning Method Based onUnsupervised Clustering Level [J]. Computer Science, 2022, 49(9): 64-69.
[2] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[3] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[4] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[5] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[6] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[7] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[8] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[9] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[10] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[11] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[12] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[13] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[14] WANG Jun-feng, LIU Fan, YANG Sai, LYU Tan-yue, CHEN Zhi-yu, XU Feng. Dam Crack Detection Based on Multi-source Transfer Learning [J]. Computer Science, 2022, 49(6A): 319-324.
[15] CHU Yu-chun, GONG Hang, Wang Xue-fang, LIU Pei-shun. Study on Knowledge Distillation of Target Detection Algorithm Based on YOLOv4 [J]. Computer Science, 2022, 49(6A): 337-344.
Full text



No Suggested Reading articles found!