Computer Science ›› 2020, Vol. 47 ›› Issue (5): 172-180.doi: 10.11896/jsjkx.190400060

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Integration of Internal and External Priors Based on Dirichlet Process Mixture Model

ZHANG Mo-hua1,2, PENG Jian-hua1   

  1. 1 National Digital Switching System Engineering & Technological Research Center,Zhengzhou 450000,China
    2 College of Computer & Information Engineering,Henan University of Economics and Law,Zhengzhou 450000,China
  • Received:2019-04-10 Online:2020-05-15 Published:2020-05-19
  • About author:ZHANG Mo-hua,born in 1979,Ph.D,associate professor,is a member of China Computer Federation.His main research interests include machine lear-ning,intelligent information processing,and image processing.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61841702),Science and Technique Foundation of Henan Province (202102210371,1521002210087),and Foundation of Henan Educational Committee (14A520040).

Abstract: In recent years,Bayesian approaches using Gaussian mixture model as a patch prior has achieved great success in image restoration.Aiming at the shortcomings of fix components and mainly relying on external learning of these models,a new image prior model based on Dirichlet process mixture model is proposed.The model learns external generic priors from a set of external clean images and learns internal priors from a given degraded image.Due to the accumulative property of the statistics in the mo-del,the integration of internal and external priori is naturally achieved in image restoration.Through the add and merge of cluster components,the model complexity can be adaptively changed as the data increases or decreases,more interpretable and more compact models can be learned.In order to solve the variational posterior of all hidden variables,a scalable variational algorithm combining with batch update with birth and merge mechanisms is proposed.The new algorithm improves the traditional coordinate ascent algorithm which is relatively inefficient under large data sets and often falls into the local optima.The effectiveness of the proposed model is verified by image denoising and inpainting experiments where the proposed model has advantage both on objective quality assessments and on visual perception comparing to traditional methods.

Key words: Batch update, Dirichlet process mixture model, Image restoration, Prior learning, Variational inference

CLC Number: 

  • TP301
[1]JAIN P,TYAGI V.LAPB:Locally adaptive patch-based wavelet domain edge-preserving image denoising[J].Information Scie-nces,2015,294:164-181.
[2]QIAO T,REN J,WANG Z,et al.Effective denoising and classification of hyperspectral images using curvelet transform and singular spectrum analysis[J].IEEE Transactions on Geoscience and Remote Sensing,2017,55(1):119-133.
[3]DABOV K,FOI A,KATKOVNIK V,et al.Image denoising by sparse 3-D transform-domain collaborative filtering[J].IEEE Transactions on Image Processing,2007,16(8):2080-2095.
[4]GAN L,ZHAO F C,YANG M.Self-adaptive group sparse Representation Method for image inpainting[J].Computer Science,2018,45(8):272-276.
[5]GAVASKAR R G,CHAUDHURY K N.Fast Adaptive Bilate-ral Filtering[J].IEEE Transactions on Image Processing,2019,28(2):779-790.
[6]GUPTA P,MOORTHY A K,SOUNDARARAJAN R,et al.Generalized Gaussian scale mixtures:A model for wavelet coefficients of natural images[J].Signal Processing:Image Communication,2018,66:87-94.
[7]XIAO J S,GAO W,PENG H,et al.DetailEnhancement for Ima-ge Super-Resolution Algorithm Based on SVD and Self-Similari-ty[J].Chinese Journal of Computers,2016,39(7):1393-1406.
[8]LEBRUN M,BUADES A,MOREL J M.A nonlocal Bayesian image denoising algorithm[J].SIAM Journal on Imaging Scie-nces,2013,6(3):1665-1688.
[9]XU J,ZHANG L,ZUO W,et al.Patch group based nonlocalself-similarity prior learning for image denoising[C]//2015 IEEE International Conference on Computer Vision (ICCV).Los Alamitos,CA,USA:IEEE Computer Society,2015:244-252.
[10]CHEN F,ZHANG L,YU H.External patch prior guided internal clustering for image denoising[C]//2015 IEEE International Conference on Computer Vision.Los Alamitos,CA,USA:IEEE Computer Society,2015:603-611.
[11]ZORAN D,WEISS Y.From learning models of natural image patches to whole image restoration[C]//2011 IEEE International Conference on Computer Vision.Piscataway,NJ,USA:IEEE,2011:479-486.
[12]XU J,ZHANG L,ZHANG D.External prior guided internalprior learning for real-world noisy image denoising[J].IEEE Transactions on Image Processing,2018,27(6):2996-3010.
[13]ULYANOV D,VEDALDI A,LEMPITSKY V.Deep imageprior[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Los Alamitos,CA,USA:IEEE Computer Society,2018:9446-9454.
[14]CHAUDHURY S,ROY H.Can fully convolutional networksperform well for general image restoration problems?[C]//2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).Nagoya,Japan:IEEE,2017:254-257.
[15]SCHMIDT U,ROTH S.Shrinkage fields for effective image restoration[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition.Los Alamitos,CA,USA:IEEE,2014:2774-2781.
[16]CHEN Y,YU W,POCK T.On learning optimized reaction diffusion processes for effective image restoration[C]//2015 IEEE International Conference on Computer Vision.Los Alamitos,CA,USA:IEEE Computer Society,2015:5261-5269.
[17]BURGER H C,SCHULER C,HARMELING S.Learning how to combine internal and external denoising methods[C]//German Conference on Pattern Recognition.Berlin:Springer,2013:121-130.
[18]MOSSERI I,ZONTAK M,IRANI M.Combining the power of internal and external denoising[C]//IEEE international conference on computational photography (ICCP).Los Alamitos,CA,USA:IEEE Computer Society,2013:1-9.
[19]MULLER P,QUINTANA F A,JARA A,et al.Bayesian nonparametric data analysis[M].New York:Springer,2015.
[20]PRABHAKARAN S,AZIZI E,CARR A,et al.Dirichlet process mixture model for correcting technical variation in single-cell gene expression data[C]//International Conference on Machine Learning.New York,USA:International Machine Learning Society,2016:1070-1079.
[21]ZHANG X.A very gentle note on the construction of dirichlet process[R].Canberra:The Australian National University,2008.
[22]SETHURAMAN J.A Constructive Definition of the Dirichlet Prior[J].Statistica Sinica,1994,4(2):639-650.
[23]HOSINO T.Two Alternative Criteria for a Split-Merge MCMC on Dirichlet Process Mixture Models[C]//InternationalConfe-rence on Artificial Neural Networks.Cham,Switzerland:Sprin-ger,2017:672-679.
[24]BLEI D M,KUCUKELBIR A,MCAULIFFE J D.Variational inference:A review for statisticians[J].Journal of the American Statistical Association,2017,112(518):859-877.
[25]HUGHES M C,SUDDERTH E B.Memoized online variational inference for Dirichlet process mixture models[J].Advances in Neural Information Processing Systems,2013:1133-1141.
[26]HUGHES M,KIM D I,SUDDERTH E B.Reliable and scalable variational inference for the hierarchical Dirichlet process[C]//18th International Conference on Artificial Intelligence and Statistics.San Diego,CA,USA:Microtome Publishing,2015:370-378.
[27]MARTIN D,FOWLKES C,TAL D,et al.A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics[C]//Eighth IEEE International Conference on Computer Vision.Piscataway,NJ,USA:IEEE,2002:416-423.
[28]WANG Y Q.E-PLE:An algorithm for image inpainting[J].Ima-ge Processing On Line,2013,3:271-285.
[1] WANG Tong-sen, SHI Qin-zhong, WANG De-fa, DONG Shuo, YANG Guo-wei, YU Teng. Nighttime Image Dehazing Method Based on Adaptive Light Source Region [J]. Computer Science, 2021, 48(11A): 327-333.
[2] LI Ze-wen, LI Zi-ming, FEI Tian-lu, WANG Rui-lin and XIE Zai-peng. Face Image Restoration Based on Residual Generative Adversarial Network [J]. Computer Science, 2020, 47(6A): 230-236.
[3] ZOU Peng, CHEN Yu-zhang, CHEN Long-biao, ZENG Zhang-fan. Night Vision Restoration Algorithm Based on Neural Network for Illumination Distribution Prediction [J]. Computer Science, 2019, 46(11A): 329-333.
[4] ZHANG Ming-qi, CAO Guo, CHEN Qiang, SUN Quan-sen. Image Restoration Method Based on Improved Inverse Filtering for Diffractive Optic Imaging Spectrometer [J]. Computer Science, 2019, 46(1): 86-93.
[5] LIU Yang, ZHANG Jie, ZHANG Hui. Study and Application of Improved Retinex Algorithm in Image Defogging [J]. Computer Science, 2018, 45(6A): 242-243.
[6] XU Ying and LI Qiang-yi. Blind Binary Image Deconvolution Based on Sparse Property [J]. Computer Science, 2018, 45(3): 253-257.
[7] LU Zhao and ZHU Xiao-shu. Research on Image Processing Algorithm Based on Compressed Sensing [J]. Computer Science, 2017, 44(6): 312-316.
[8] LIU Fu-yong, GAO Xian-qiang and ZHANG Zhu. Improved Bayesian Probabilistic Model Based Recommender System [J]. Computer Science, 2017, 44(5): 285-289.
[9] ZHAO Zhi-gang, CHEN Ying-ying, ZHAO Yi, ZHANG Wei-zhong, LV Hui-xian and PAN Zhen-kuan. Motion Deblurring Based on Edge Prior Model [J]. Computer Science, 2015, 42(5): 305-308.
[10] LIU Jian-wei, CUI Li-peng, LI Hai-en and LUO Xiong-lin. Research and Development on Inference Technique in Probabilistic Graphical Models [J]. Computer Science, 2015, 42(4): 1-18.
[11] SUI Dan and GAO Guo-wei. Image Restoration Algorithm of Unknown Priori Pixel Based on Artificial Fish Swarm Decomposition [J]. Computer Science, 2015, 42(3): 316-320.
[12] LIU Xiao-yan and FENG Xiang-chu. High-order Regularization Model for Image Denoising in Symmetric Tensor Space [J]. Computer Science, 2013, 40(Z11): 359-362.
[13] XIAO Quan,DING Xing-hao,LIAO Ying-hao. Novel Edge-preserving Algorithm for Defocus Blurred Image Restoration 降 [J]. Computer Science, 2010, 37(7): 270-272.
[14] XIAO Su,HAN Guo-qiang,WO Yan. Multichannel Blind Image Restoration [J]. Computer Science, 2010, 37(12): 234-237.
[15] LI Ming-he,HE Bin,YUE Ji-guang,LU Han-xiong,LI Yong-gang. Uniform Motion Burred Image Restoration Algorithm Based on the Z-transform and Fuzzy Weighted Mean Filter [J]. Computer Science, 2010, 37(10): 260-262.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!