Computer Science ›› 2019, Vol. 46 ›› Issue (8): 298-302.doi: 10.11896/j.issn.1002-137X.2019.08.049

• Graphics ,Image & Pattern Recognition • Previous Articles     Next Articles

Face Hallucination Reconstruction Algorithm Based on Hierarchical Clustering Regression Model

WANG Shu-yun, GAN Zong-liang, LIU Feng   

  1. (Jiangsu Province Key Lab on Image Processing and Image Communication,Nanjing University of Posts and Telecommunications,Nanjing 210003,China)
  • Received:2018-07-31 Online:2019-08-15 Published:2019-08-15

Abstract: Face hallucination reconstruction refers to the process of reconstructing high-resolution enhanced face from a low-resolution image.Most of the traditional methods assume that the input image is aligned and noise-free.However,the super resolution performance will decrease when the input facial image is unaligned and affectedby noise.This paper proposed an effective single image super resolution method for unaligned face images,in which the learning-based hierarchical clustering regression approach is used to get better reconstruction model.The proposed face hallucination methodcan be divided into clustering and regression.In the clustering part,a dictionary is trained on the whole face image with tiny size,and the training images are clustered based on the Euclidean distance.Thus,the facial structural prior is fully utilized and the accurate clustering result can be obtained.In the regression part,to reduce the time complexity effectively,only one global dictionary needs to be trained during the entire training phase whose atoms are taken as the anchors.In particular,the learned anchors are shared with all the clusters.For each cluster,the Euclidean distance is used to search the nearest neighbors for each anchor to form the subspace.Moreover,in every subspace,a regression model is learned to map the relationship between low-resolution features and high-resolution samples.The core idea of this method is to utilize the same anchors but different samples for clusters to learn the local mapping more accurately,which can reduce training time and improve reconstruction quality.The results of comparative experiments with other algorithms show that the PSNR can be increased by at least 0.39 dB and the SSIM can be increased by 0.01 to 0.18

Key words: Euclidean distance, Face hallucination, Hierarchical, Regression, Super resolution

CLC Number: 

  • TN919
[1]ROWEIS SAM T,SAUL L K.Nonlinear Dimensionality Reduction by Locally Linear Embedding[J].Science,2000,290(5500):2323.
[2]CHANG H,YEUNG D Y,XIONG Y.Super-Resolution through Neighbor Embedding[C]∥IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington,2004:275-282.
[3]MA X,ZHANG J,QI C.Hallucinating face by position-patch [J].Pattern Recognition,2010,43(6):2224-2236.
[4]MA X,LUONG H Q,PHILIPS W,et al.Sparse representation and position prior based face hallucination upon classified over-complete dictionaries [J].Signal Processing,2012,92(9):2066-2074.
[5]WANG Z,HU R,WANG S,et al.Face Hallucination Via Weighted Adaptive Sparse Regularization [J].IEEE Transactions on Circuits & Systems for Video Technology,2014,24(5):802-813.
[6]JIANG J,HU R,WANG Z,et al.Noise Robust Face Hallucination via Locality-Constrained Representation [J].IEEE Tran-sactions on Multimedia,2014,16(5):1268-1281.
[7]JIANG J,MA J,CHEN C,et al.Noise Robust Face Image Super-Resolution Through Smooth Sparse Representation[J].IEEE Transactions on Cybernetics,2017,PP(99):1-12.
[8]JIANG J,HU R,WANG Z,et al.Facial Image Hallucination Through Coupled-Layer Neighbor Embedding [J].IEEE Tran-sactions on Circuits & Systems for Video Technology,2016,26(9):1674-1684.
[9]JIAO C,GAN Z,QI L,et al.Novel Face Hallucination Through Patch Position Based Multiple Regressors Fusion[C]∥Chinese Conference on Pattern Recognition.Singapore:Springer,2016:369-382.
[10]TIMOFTE R,SMET V D,GOOL L V.A+:Adjusted Anchored Neighborhood Regression for Fast Super-Resolution[C]∥Asian Conference on Computer Vision.Cham:Springer,2014:111-126.
[11]JIANG J,YU Y,HU J,et al.Deep CNN Denoiser and Multi- layer Neighbor Component Embedding for Face Hallucination[OL].https:arXiv.org/pdf/1806.10726.pdf.
[12]YU X,PORIKLI F.Hallucinating Very Low-Resolution Una- ligned and Noisy Face Images by Transformative Discriminative Autoencoders[M]∥Computer Vision and Pattern Recognition.Berlin:Springer,2017:5367-5375.
[13]CAO Q,LIN L,SHI Y,et al.Attention-Aware Face Hallucination via Deep Reinforcement Learning[OL].https://arXiv.org/pdf/1708.03132.pdf.
[14]AHARON M,ELAD M,BRUCKSTEIN A.K-SVD:An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation [J].IEEE Transactions on Signal Processing,2006,54(11):4311-4322.
[15]CAO Q,SHEN L,XIE W,et al.Vggface2:A Dataset for Recognising Faces across Pose and Age [OL].https://arXiv.org/pdf/1710.08092.pdf.
[16]DONG C,CHEN C L,HE K,et al.Image Super-Resolution Using Deep Convolutional Networks [J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2016,38(2):295-307.
[1] HU Yu-jiao, JIA Qing-min, SUN Qing-shuang, XIE Ren-chao, HUANG Tao. Functional Architecture to Intelligent Computing Power Network [J]. Computer Science, 2022, 49(9): 249-259.
[2] LYU You, WU Wen-yuan. Privacy-preserving Linear Regression Scheme and Its Application [J]. Computer Science, 2022, 49(9): 318-325.
[3] QIN Qi-qi, ZHANG Yue-qin, WANG Run-ze, ZHANG Ze-hua. Hierarchical Granulation Recommendation Method Based on Knowledge Graph [J]. Computer Science, 2022, 49(8): 64-69.
[4] YANG Wen-kun, YUAN Xiao-pei, CHEN Xiao-feng, GUO Rui. Spatial Multi-feature Segmentation of 3D Lidar Point Cloud [J]. Computer Science, 2022, 49(8): 143-149.
[5] WANG Wen-qiang, JIA Xing-xing, LI Peng. Adaptive Ensemble Ordering Algorithm [J]. Computer Science, 2022, 49(6A): 242-246.
[6] YANG Jian-nan, ZHANG Fan. Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure [J]. Computer Science, 2022, 49(6A): 353-357.
[7] CHEN Yong-ping, ZHU Jian-qing, XIE Yi, WU Han-xiao, ZENG Huan-qiang. Real-time Helmet Detection Algorithm Based on Circumcircle Radius Difference Loss [J]. Computer Science, 2022, 49(6A): 424-428.
[8] LUO Jun-ren, ZHANG Wan-peng, LU Li-na, CHEN Jing. Survey on Online Adversarial Planning for Real-time Strategy Game [J]. Computer Science, 2022, 49(6): 287-296.
[9] LI Jing-tai, WANG Xiao-dan. XGBoost for Imbalanced Data Based on Cost-sensitive Activation Function [J]. Computer Science, 2022, 49(5): 135-143.
[10] ZHAO Yue, YU Zhi-bin, LI Yong-chun. Cross-attention Guided Siamese Network Object Tracking Algorithm [J]. Computer Science, 2022, 49(3): 163-169.
[11] DU Hui, LI Zhuo, CHEN Xin. Incentive Mechanism for Hierarchical Federated Learning Based on Online Double Auction [J]. Computer Science, 2022, 49(3): 23-30.
[12] LI Zong-ran, CHEN XIU-Hong, LU Yun, SHAO Zheng-yi. Robust Joint Sparse Uncorrelated Regression [J]. Computer Science, 2022, 49(2): 191-197.
[13] LIU Zhen-yu, SONG Xiao-ying. Multivariate Regression Forest for Categorical Attribute Data [J]. Computer Science, 2022, 49(1): 108-114.
[14] CHEN Le, GAO Ling, REN Jie, DANG Xin, WANG Yi-hao, CAO Rui, ZHENG Jie, WANG Hai. Adaptive Bitrate Streaming for Energy-Efficiency Mobile Augmented Reality [J]. Computer Science, 2022, 49(1): 194-203.
[15] FAN Jia-xing, WANG Zhi-wei. Hierarchical Anonymous Voting Scheme Based on Threshold Ring Signature [J]. Computer Science, 2022, 49(1): 321-327.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!