计算机科学 ›› 2019, Vol. 46 ›› Issue (8): 298-302.doi: 10.11896/j.issn.1002-137X.2019.08.049

• 图形图像与模式识别 • 上一篇    下一篇

基于层级聚类回归模型的人脸超分辨率重建算法

王淑云, 干宗良, 刘峰   

  1. (南京邮电大学江苏省图像处理与图像通信重点实验室 南京210003)
  • 收稿日期:2018-07-31 出版日期:2019-08-15 发布日期:2019-08-15
  • 通讯作者: 干宗良(1979-),男,博士,副教授,主要研究方向为分布式视频编码和图像视频信号处理等,E-mail:ganzl@njupt.edu.cn
  • 作者简介:王淑云(1991-),女,硕士生,主要研究方向为图像处理、计算机视觉,E-mail:1016010509@njupt.edu.cn;刘峰(1964-),男,博士,教授,主要研究方向为图像处理与网络视频通信、高速DSP与嵌入式应用系统设计等
  • 基金资助:
    国家自然科学基金(60802021,61172118,61271240,61471201),江苏省高校自然科学重点研究项目(13KJA510004),江苏省自然科学基金青年基金(BK20130867),江苏省高校自然科学研究(12KJB510019)

Face Hallucination Reconstruction Algorithm Based on Hierarchical Clustering Regression Model

WANG Shu-yun, GAN Zong-liang, LIU Feng   

  1. (Jiangsu Province Key Lab on Image Processing and Image Communication,Nanjing University of Posts and Telecommunications,Nanjing 210003,China)
  • Received:2018-07-31 Online:2019-08-15 Published:2019-08-15

摘要: 人脸超分辨率重建是指从一幅低分辨率人脸图像重建出相应的高分辨率图像的过程。大部分的人脸超分辨率重建算法都假设输入图像是对齐且不含噪声的。当输入的人脸图像为非对齐时,超分辨率重建的性能将降低。为此,提出一种基于学习的层级聚类回归算法,其主要针对非对齐的单帧人脸图像的超分辨率重建。该算法分为两部分:聚类和回归。聚类阶段,将训练样本的尺寸统一成某个小尺寸的人脸图像,用于训练人脸图像字典。该字典的字典原子为聚类中心,对原始的人脸图像进行聚类,得到各个子空间的人脸图像簇。该算法充分利用了人脸结构的先验信息,能获得更准确的聚类结果。在回归阶段,仅需要训练一个全局字典,各个子空间的人脸图像共享这些字典原子。在每个簇内,搜索各个驻点的邻域,以生成对应的邻域子空间。然后,学习低分辨率与高分辨率样本特征之间的映射关系,以得到每个子空间的回归模型。该算法的核心是所有的人脸图像类共享一个全局字典,但对于同一个驻点,在不同的人脸图像簇内,邻域样本各不相同,这样能够更准确地学习局部映射关系。该算法不仅可以缩短训练时间,还可以提高人脸超分辨率重建的质量。对比实验的结果表明,该算法的PSNR至少可以提升0.39dB,SSIM可以提升0.01~0.18。

关键词: 层级, 超分辨率, 回归, 欧氏距离, 人脸超分辨率

Abstract: Face hallucination reconstruction refers to the process of reconstructing high-resolution enhanced face from a low-resolution image.Most of the traditional methods assume that the input image is aligned and noise-free.However,the super resolution performance will decrease when the input facial image is unaligned and affectedby noise.This paper proposed an effective single image super resolution method for unaligned face images,in which the learning-based hierarchical clustering regression approach is used to get better reconstruction model.The proposed face hallucination methodcan be divided into clustering and regression.In the clustering part,a dictionary is trained on the whole face image with tiny size,and the training images are clustered based on the Euclidean distance.Thus,the facial structural prior is fully utilized and the accurate clustering result can be obtained.In the regression part,to reduce the time complexity effectively,only one global dictionary needs to be trained during the entire training phase whose atoms are taken as the anchors.In particular,the learned anchors are shared with all the clusters.For each cluster,the Euclidean distance is used to search the nearest neighbors for each anchor to form the subspace.Moreover,in every subspace,a regression model is learned to map the relationship between low-resolution features and high-resolution samples.The core idea of this method is to utilize the same anchors but different samples for clusters to learn the local mapping more accurately,which can reduce training time and improve reconstruction quality.The results of comparative experiments with other algorithms show that the PSNR can be increased by at least 0.39 dB and the SSIM can be increased by 0.01 to 0.18

Key words: Euclidean distance, Face hallucination, Hierarchical, Regression, Super resolution

中图分类号: 

  • TN919
[1]ROWEIS SAM T,SAUL L K.Nonlinear Dimensionality Reduction by Locally Linear Embedding[J].Science,2000,290(5500):2323.
[2]CHANG H,YEUNG D Y,XIONG Y.Super-Resolution through Neighbor Embedding[C]∥IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington,2004:275-282.
[3]MA X,ZHANG J,QI C.Hallucinating face by position-patch [J].Pattern Recognition,2010,43(6):2224-2236.
[4]MA X,LUONG H Q,PHILIPS W,et al.Sparse representation and position prior based face hallucination upon classified over-complete dictionaries [J].Signal Processing,2012,92(9):2066-2074.
[5]WANG Z,HU R,WANG S,et al.Face Hallucination Via Weighted Adaptive Sparse Regularization [J].IEEE Transactions on Circuits & Systems for Video Technology,2014,24(5):802-813.
[6]JIANG J,HU R,WANG Z,et al.Noise Robust Face Hallucination via Locality-Constrained Representation [J].IEEE Tran-sactions on Multimedia,2014,16(5):1268-1281.
[7]JIANG J,MA J,CHEN C,et al.Noise Robust Face Image Super-Resolution Through Smooth Sparse Representation[J].IEEE Transactions on Cybernetics,2017,PP(99):1-12.
[8]JIANG J,HU R,WANG Z,et al.Facial Image Hallucination Through Coupled-Layer Neighbor Embedding [J].IEEE Tran-sactions on Circuits & Systems for Video Technology,2016,26(9):1674-1684.
[9]JIAO C,GAN Z,QI L,et al.Novel Face Hallucination Through Patch Position Based Multiple Regressors Fusion[C]∥Chinese Conference on Pattern Recognition.Singapore:Springer,2016:369-382.
[10]TIMOFTE R,SMET V D,GOOL L V.A+:Adjusted Anchored Neighborhood Regression for Fast Super-Resolution[C]∥Asian Conference on Computer Vision.Cham:Springer,2014:111-126.
[11]JIANG J,YU Y,HU J,et al.Deep CNN Denoiser and Multi- layer Neighbor Component Embedding for Face Hallucination[OL].https:arXiv.org/pdf/1806.10726.pdf.
[12]YU X,PORIKLI F.Hallucinating Very Low-Resolution Una- ligned and Noisy Face Images by Transformative Discriminative Autoencoders[M]∥Computer Vision and Pattern Recognition.Berlin:Springer,2017:5367-5375.
[13]CAO Q,LIN L,SHI Y,et al.Attention-Aware Face Hallucination via Deep Reinforcement Learning[OL].https://arXiv.org/pdf/1708.03132.pdf.
[14]AHARON M,ELAD M,BRUCKSTEIN A.K-SVD:An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation [J].IEEE Transactions on Signal Processing,2006,54(11):4311-4322.
[15]CAO Q,SHEN L,XIE W,et al.Vggface2:A Dataset for Recognising Faces across Pose and Age [OL].https://arXiv.org/pdf/1710.08092.pdf.
[16]DONG C,CHEN C L,HE K,et al.Image Super-Resolution Using Deep Convolutional Networks [J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2016,38(2):295-307.
[1] 吕由, 吴文渊.
隐私保护线性回归方案与应用
Privacy-preserving Linear Regression Scheme and Its Application
计算机科学, 2022, 49(9): 318-325. https://doi.org/10.11896/jsjkx.220300190
[2] 杨文坤, 原晓佩, 陈小锋, 郭睿.
三维激光雷达点云空间多特征分割
Spatial Multi-feature Segmentation of 3D Lidar Point Cloud
计算机科学, 2022, 49(8): 143-149. https://doi.org/10.11896/jsjkx.210300275
[3] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
[4] 陈永平, 朱建清, 谢懿, 吴含笑, 曾焕强.
基于外接圆半径差损失的实时安全帽检测算法
Real-time Helmet Detection Algorithm Based on Circumcircle Radius Difference Loss
计算机科学, 2022, 49(6A): 424-428. https://doi.org/10.11896/jsjkx.220100252
[5] 王文强, 贾星星, 李朋.
自适应的集成定序算法
Adaptive Ensemble Ordering Algorithm
计算机科学, 2022, 49(6A): 242-246. https://doi.org/10.11896/jsjkx.210200108
[6] 李京泰, 王晓丹.
基于代价敏感激活函数XGBoost的不平衡数据分类方法
XGBoost for Imbalanced Data Based on Cost-sensitive Activation Function
计算机科学, 2022, 49(5): 135-143. https://doi.org/10.11896/jsjkx.210400064
[7] 赵越, 余志斌, 李永春.
基于互注意力指导的孪生跟踪算法
Cross-attention Guided Siamese Network Object Tracking Algorithm
计算机科学, 2022, 49(3): 163-169. https://doi.org/10.11896/jsjkx.210300066
[8] 周颖, 常明新, 叶红, 张燕.
基于元迁移的太阳能电池板缺陷图像超分辨率重建方法
Super Resolution Reconstruction Method of Solar Panel Defect Images Based on Meta-transfer
计算机科学, 2022, 49(3): 185-191. https://doi.org/10.11896/jsjkx.210100234
[9] 陈贵强, 何军.
自然场景下遥感图像超分辨率重建算法研究
Study on Super-resolution Reconstruction Algorithm of Remote Sensing Images in Natural Scene
计算机科学, 2022, 49(2): 116-122. https://doi.org/10.11896/jsjkx.210700095
[10] 冷佳旭, 王佳, 莫梦竟成, 陈泰岳, 高新波.
基于深度学习的视频超分辨率重构进展综述
Survey on Video Super-resolution Based on Deep Learning
计算机科学, 2022, 49(2): 123-133. https://doi.org/10.11896/jsjkx.211000007
[11] 李宗然, 陈秀宏, 陆赟, 邵政毅.
鲁棒联合稀疏不相关回归
Robust Joint Sparse Uncorrelated Regression
计算机科学, 2022, 49(2): 191-197. https://doi.org/10.11896/jsjkx.210300034
[12] 陈乐, 高岭, 任杰, 党鑫, 王祎昊, 曹瑞, 郑杰, 王海.
基于自适应码率移动增强现实应用的能效优化研究
Adaptive Bitrate Streaming for Energy-Efficiency Mobile Augmented Reality
计算机科学, 2022, 49(1): 194-203. https://doi.org/10.11896/jsjkx.201100107
[13] 刘振宇, 宋晓莹.
一种可用于分类型属性数据的多变量回归森林
Multivariate Regression Forest for Categorical Attribute Data
计算机科学, 2022, 49(1): 108-114. https://doi.org/10.11896/jsjkx.201200189
[14] 陈长伟, 周晓峰.
快速局部协同表示分类器及其在人脸识别中的应用
Fast Local Collaborative Representation Based Classifier and Its Applications in Face Recognition
计算机科学, 2021, 48(9): 208-215. https://doi.org/10.11896/jsjkx.200800155
[15] 周文辉, 石敏, 朱登明, 周军.
基于残差注意力网络的地震数据超分辨率方法
Seismic Data Super-resolution Method Based on Residual Attention Network
计算机科学, 2021, 48(8): 24-31. https://doi.org/10.11896/jsjkx.200900034
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!