Computer Science ›› 2022, Vol. 49 ›› Issue (3): 185-191.doi: 10.11896/jsjkx.210100234

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Super Resolution Reconstruction Method of Solar Panel Defect Images Based on Meta-transfer

ZHOU Ying1,2, CHANG Ming-xin1, YE Hong1, ZHANG Yan1   

  1. 1 School of Artificial Intelligence and Data Science,Hebei University of Technology,Tianjin 300130,China
    2 China Hebei Control Engineering Research Center,Tianjin 300130,China
  • Received:2021-01-29 Revised:2021-05-02 Online:2022-03-15 Published:2022-03-15
  • About author:ZHOU Ying,born in 1971,Ph.D,asso-ciate professor.Her main research inte-rests include computer vision,image processing and deep learning.
    ZHANG Yan,born in 1974,Ph.D,professor,Ph.D supervisor.Her main research interests include intelligent rehabilitation device and control theory.
  • Supported by:
    National Natural Science Foundation of China(60741307) and Innovation Capability Enhancement Program Project of Hebei Province(18961604H).

Abstract: It is difficult to detect solar panel crack defect due to low resolution and contrast,and few samples lead to inadequate training problem.To solve these problems,this paper puts forward the super resolution reconstruction method of solar panel images based on meta-transfer,and we adopt joint training method,that is,the internal image and external large-scale image information are used as the different stages of training data.First,a large amount of data is used to pretrain the model to learn the external public characteristics of large-scale data.Then,we use the meta-learning model MAML for multi-task training to find initial parameters,which are suitable for the unsupervised task of few samples to improve the generalization ability of the model.Finally,we put pretrained parameters in improved ZSSR to improve the Self-supervised Learning.Through DIV2K,Set5,BSD100 and solar panels electroluminescent imaging training dataset,the experimental results show that compared with the traditional CARN,RCAN,IKC and ZSSR,this method has the higher peak signal-to-noise ratio,up to 36.66,and fewer parameters,compared with ZSSR,the number of parameters decreases by 70 000 with shorter computation time,and compared with CARN,the computation time decreases by 0.51 s.It is obvious that our method has the better reconstruction effect,the higher reconstruction efficiency.

Key words: Convolutional neural network, DIV2K training set, Meta-learning, Solar panel defects, Super-resolution reconstruction

CLC Number: 

  • TP391
[1]JIANG J,LI M,ZHU M Q,et al.Crack detection of outdoorsolar panel based on convolutional neural network[J].Journal of Yangzhou University (Natural Science Edition),2020,23(1):49-53.
[2]CHEN F M,CHENG X Y,YAO Z F.Design of Solar PanelDefect Detection Model Based on Deep Learning[J].Wireless Interconnection Technology,2019,16(23):56-61.
[3]GUO B S,ZHUANG J C,ZHANG Q,et al.Color difference detection of polysilicon wafers based on multi-component convolutional neural network[J].China Mechanical Engineering,2021,23(18):1-10.
[4]SHOCHER A,COHEN N,IRANI M.Zero-Shot Super-Resolu-tion Using Deep Internal Learning[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Salt Lake City,UT,2018:3118-3126.
[5]MASTAN I D,RAMAN S.DCIL:Deep Contextual InternalLearning for Image Restoration and Image Retargeting[C]//2020 IEEE Winter Conference on Applications of Computer Vision (WACV).Snowmass Village,CO,USA,2020:2355-2364.
[6]JUNZHI Y.Zero-Shot Super Resolution for Satellite RemoteSensing Images[C]//2019 IEEE International Conference on Signal,Information and Data Processing (ICSIDP).IEEE,2019:245-255.
[7] FELUI-FABÁ J,FAN Y,YING L.Meta-learning pseudo-diffe-rential operators with deep neural networks[J].Journal of Computational Physics,2020,5(23):408-415.
[8]PURI R.Few Shot Learning For Point Cloud Data Using Model Agnostic Meta Learning[J].2020 IEEE International Confe-rence on Image Processing (ICIP),2020,13(5):1906-1910.
[9]DEMERTZIS K,ILIADIS L.GeoAI:A Model-Agnostic Meta-Ensemble Zero-Shot Learning Method for Hyperspectral Image Analysis and Classification[J].Algorithms,2020,13(3):61-68.
[10]XU Z,CHEN X,TANG W,et al.Meta Weight Learning viaModel-Agnostic Meta-Learning[J].Neurocomputing,2020,432(7587):342-356.
[11]EIRIKUR A,RADU T.Ntire 2017 challenge on single image super-resolution:Dataset and study[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.2017:126-135.
[12]LI Y M.Study on Bicubic Interpolation Algorithm for Images[D].Lanzhou:Lanzhou University,2020.
[13]WANG J L,LIU L Q,ZHANG C M.Application of image processing in photovoltaic local shadow[J].Journal of Solar Energy,2020,41(2):284-289.
[14]WU G,ZHAO L,WANG W,et al.PRED:A Parallel Network for Handling Multiple Degradations via Single Model in Single Image Super-Resolution[C]//2019 IEEE International Confe-rence on Image Processing (ICIP).Taipei,Taiwan,2019:5-10.
[15]CHOLLET F.Xception:Deep Learning with Depthwise Separable Convolutions[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2017.
[16]TAHIR S,JALAL A,KIM K.Wearable Inertial Sensors forDaily Activity Analysis Based on Adam Optimization and the Maximum Entropy Markov Model[J].Entropy (Basel,Swit-zerland),2020,22(5):1250-1258.
[17]LAN R,SUN L,LIU Z,et al.Cascading and Enhanced Residual Networks for Accurate Single-Image Super-Resolution[J].IEEE Transactions on Cybernetics,2020,43(99):1-11.
[18]MARCO B,ALINE R,CHRISTINE G,et al.Low-complexity single-image super-resolution based on nonnegative neighbor embedding[J].BMVC,2012,54(9):104-110.
[19]DAVID M,CHARLESS F,DORON T,et al.A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics[J].Computer Vision,2001,19(6):416-423.
[20]MEHTA J H.Relation between Entropy and Peak Signal toNoise Ratio in Prediction Error Expansion Considering Region of Interest[J].International Conference for Convergence in Technology (I2CT),2019,69(9):1-4.
[21]ELACHKAR I,OUZIF H,LABRIJI H.Structural SimilarityMeasure of Users Profiles Based on A Weighted Bipartite Graphs[J].ISPRS International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences,2020,66(5):1-9.
[22]LAN R,SUN L,LIU Z,et al.Cascading and Enhanced Residual Networks for Accurate Single-Image Super-Resolution[J].IEEE Transactions on Cybernetics,2020,66(99):146-155.
[23]QI Y,GU J,LI W,et al.Pulmonary nodule image super-resolution using multi-scale deep residual channel attention network with joint optimization[J].The Journal of Supercomputing,2019,76(3):1508-1515.
[24]DENIZ K,HAKAN A.A Novel Short-Term Photovoltaic Power Forecasting Approach based on Deep Convolutional Neural Network[J].International Journal of Green Energy,2021,18(5):34-39.
[25]LEE K,LEE E,CHOI B,et al.Automatic Pharyngeal PhaseRecognition in Untrimmed Videofluoroscopic Swallowing Study Using Transfer Learning with Deep Convolutional Neural Networks[J].Diagnostics,2021,11(2):622-630.
[26]GU J,LU H,ZUO W,et al.Blind Super-Resolution with Iterative Kernel Correction[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).2019:1245-1250.
[1] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[2] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[3] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[4] QI Xiu-xiu, WANG Jia-hao, LI Wen-xiong, ZHOU Fan. Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning [J]. Computer Science, 2022, 49(7): 18-24.
[5] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[6] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
[7] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[8] WU Zi-bin, YAN Qiao. Projected Gradient Descent Algorithm with Momentum [J]. Computer Science, 2022, 49(6A): 178-183.
[9] ZHANG Jia-hao, LIU Feng, QI Jia-yin. Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer [J]. Computer Science, 2022, 49(6A): 370-377.
[10] WANG Jian-ming, CHEN Xiang-yu, YANG Zi-zhong, SHI Chen-yang, ZHANG Yu-hang, QIAN Zheng-kun. Influence of Different Data Augmentation Methods on Model Recognition Accuracy [J]. Computer Science, 2022, 49(6A): 418-423.
[11] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[12] YANG Yue, FENG Tao, LIANG Hong, YANG Yang. Image Arbitrary Style Transfer via Criss-cross Attention [J]. Computer Science, 2022, 49(6A): 345-352.
[13] YANG Jian-nan, ZHANG Fan. Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure [J]. Computer Science, 2022, 49(6A): 353-357.
[14] ZHAO Zheng-peng, LI Jun-gang, PU Yuan-yuan. Low-light Image Enhancement Based on Retinex Theory by Convolutional Neural Network [J]. Computer Science, 2022, 49(6): 199-209.
[15] HU Fu-yuan, WAN Xin-jun, SHEN Ming-fei, XU Jiang-lang, YAO Rui, TAO Zhong-ben. Survey Progress on Image Instance Segmentation Methods of Deep Convolutional Neural Network [J]. Computer Science, 2022, 49(5): 10-24.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!