Computer Science ›› 2026, Vol. 53 ›› Issue (8): 209-218.doi: 10.11896/jsjkx.250500082

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Lightweight Low-resolution Face Recognition via Hierarchical Dynamic Feature Generation Distillation

ZHONG Rui, YAN Hongwei, LIU Jiawei   

  1. School of Mathematics and Computer Science, Gannan Normal University, Ganzhou, Jiangxi 341000, China
  • Received:2025-05-20 Revised:2025-11-20 Online:2026-08-15 Published:2026-08-17
  • About author:ZHONG Rui,born in 1984,Ph.D,asso-ciate professor,is a member of CCF(No.R4389M).His main research interests include computer vision and pattern recognition.
  • Supported by:
    National Natural Science Foundation of China(62266003), Jiangxi Provincial Natural Science Foundation(20232BAB202056),Science and Technology Project of Jiangxi Provincial Department of Education(GJJ211401) and Jiangxi Basic Education Research Project(SZUGSXX2024-1068).

Abstract: For low-resolution face recognition scenarios demanding high accuracy,efficiency,and lightweight design,this study proposes a HDFGD(Hierarchical Dynamic Feature Generation Distillation) framework.Based on feature redundancy theory and knowledge distillation,the framework constructs a dynamic hierarchical feature generation module to enhance the feature representation capabilities of lightweight student networks.The module expands feature diversity through channel-wise convolutions,employs channel attention mechanisms to focus on critical semantic information,and integrates adaptive compression mechanisms to reduce computational complexity,effectively mitigating semantic gaps across resolution-specific features.Simultaneously,the ArcFace loss function is incorporated to optimize angular-margin constraints in the feature space,thereby strengthening intra-class compactness and inter-class separability,and ultimately improving the accuracy of low-resolution face recognition.Experimental results demonstrate that the HDFGD framework achieves a maximum 2.1% improvement in accuracy over mainstream methods on the CIFAR-100 classification task.It also attains recognition accuracies of 95.87% and 97.02% respectively on two benchmark low-resolution face re-cognition datasets,significantly outperforming existing lightweight face recognition algorithms.Ablation studies confirm that the combination of dynamic feature generation with hierarchical alignment strategies and the ArcFace discriminative supervision mechanism simultaneously achieves triple breakthroughs:model lightweighting,cross-resolution feature robustness,and recognition accuracy enhancement.This framework provides an efficient technical solution for real-time face recognition tasks in resource-constrained scenarios.

Key words: Low-resolution face recognition, Knowledge distillation, Dynamic feature generation, Lightweight, Hierarchical

CLC Number: 

  • TP391
[1] HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:770-778.
[2] SCHROFF F,KALENICHENKO D,PHILBIN J.FaceNet:AUnified Embedding for Face Recognition and Clustering[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2015:815-823.
[3] GROTHER P,NGAN M,HANAOKA Y,et al.Face Recognition Vendor Test(FRVT) Part 3:Demographic Effects[R].Gaithersburg:National Institute of Standards and Technology,2021.
[4] ZHANG X,KU S P.Facial super-resolution reconstructionmethod based on generative adversarial networks[J].Journal of Jilin University(Engineering and Technology Edition),2025,55(1):333-338.
[5] BISWAS S,BOWYER K W,FLYNN P J.Multidimensionalscaling for matching low-resolution face images[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(10):2019-2030.
[6] DONG C,LOY C C,HE K,et al.Image Super-Resolution Using Deep Convolutional Networks[C]//Proceedings of the European Conference on Computer Vision.Springer,2014:184-199.
[7] WANG X,YU K,WU S,et al.ESRGAN:Enhanced Super-Re-solution Generative Adversarial Networks[C]//Proceedings of the European Conference on Computer Vision.Springer,2018:63-79.
[8] YU X,FERNANDO B,GHANEM B,et al.Face super-resolution guided by facial component heatmaps[C]//Proceedings of the European Conference on Computer Vision.Springer,2018:217-233.
[9] REN C X,DAI D Q,YAN H.Coupled kernel embedding for low-resolution face image recognition[J].IEEE Transactions on Image Processing,2012,21(8):3770-3783.
[10] HINTON G,VINYALS O,DEAN J.Distilling the Knowledgein a Neural Network[J].Computer Science,2015,14(7):38-39.
[11] KULLBACK S,LEIBLER R A.On information and sufficiency[J].The Annals of Mathematical Statistics,1951,22(1):79-86.
[12] ROMERO A,BALLAS N,KAHOU S E,et al.FitNets:Hints for Thin Deep Nets[C]//Proceedings of the International Conference on Learning Representations.2015.
[13] GE S,ZHAO S,LI C,et al.Low-resolution face recognition in the wild via selective knowledge distillation[J].IEEE Transactions on Image Processing,2019,28(4):2051-2062.
[14] HOWARD A,SANDLER M,CHU G,et al.Searching for MobileNetV3[C]//Proceedings of the IEEE International Confe-rence on Computer Vision.IEEE,2019:1314-1324.
[15] GUO J,CHEN M,HU Y,et al.Reducing the Teacher-Student Gap via Spherical Knowledge Distillation[J].arXiv:2010.07485,2020
[16] CHI Z,ZHENG T,LI H,et al.NormKD:Normalized Logits for Knowledge Distillation[J].arXiv:2308.00520,2023.
[17] HAN K,WANG Y,TIAN Q,et al.GhostNet:More Featuresfrom Cheap Operations[C]//Proceedings of the IEEE Confe-rence on Computer Vision and Pattern Recognition.IEEE,2020:1580-1589.
[18] DENG J,GUO J,XUE N,et al.ArcFace:Additive Angular Margin Loss for Deep Face Recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2019:4690-4699.
[19] SINHA D,EL-SHARKAWY M.Thin MobileNet:An Enhanced MobileNet Architecture[C]//Proceedings of the IEEE 10th Annual Ubiquitous Computing,Electronics & Mobile Communication Conference.New York:IEEE,2019:280-285.
[20] LUO P,ZHU Z,LIU Z,et al.Face Model Compression by Dis-tilling Knowledge from Neurons[C]//Proceedings of the AAAI Conference on Artificial Intelligence.AAAI,2016:3560-3566.
[21] GE S,ZHAO S,LI C,et al.Efficient Low-Resolution Face Re-cognition via Bridge Distillation[J].IEEE Transactions on Image Processing,2020,29:6898-6908.
[22] ZHANG K,GE S,SHI R,et al.Low-Resolution Object Recognition with Cross-Resolution Relational Contrastive Distillation[J].IEEE Transactions on Circuits and Systems for Video Technology,2024,34(4):2374-2384.
[23] HAO Z,GUO J,HAN K,et al.One-for-all:bridge the gap between heterogeneous architectures in knowledge distillation[C]//Proceedings of the 36th Conference on Advances in Neural Information Processing Systems.PMLR,2024:123-135.
[24] HUANG Z H,YANG S Z,LIN W,et al.Knowledge Distil-lation:A Survey[J].Chinese Journal of Computers,2022,45(3):624-653.
[25] ZHAO B,CUI Q,SONG R,et al.Decoupled Knowledge Distillation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2022:11953-11962.
[26] JI M,HEO B,PARK S.Show,Attend and Distill:KnowledgeDistillation via Attention-Based Feature Matching[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:7945-7952.
[27] PENG B,JIN X,LIU J,et al.Correlation Congruence forKnowledge Distillation[C]//Proceedings of the IEEE International Conference on Computer Vision.IEEE,2019:5007-5016.
[28] ZHU Y,WANG Y.Student Customized Knowledge Distillation:Bridging the Gap Between Student and Teacher[C]//Procee-dings of the IEEE International Conference on Computer Vision.IEEE,2021:5057-5066.
[29] YANG C,AN Z,CAI L,et al.Knowledge Distillation Using Hierarchical Self-Supervision Augmented Distribution[J].IEEE Transactions on Neural Networks and Learning Systems,2024,35(2):2094-2108.
[30] HU J,SHEN L,SUN G.Squeeze-and-Excitation Networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2018:7132-7141.
[31] KRIZHEVSKY A,NAIR V,HINTON G.Learning MultipleLayers of Features from Tiny Images[R].Toronto:University of Toronto,2009.
[32] SUN Y,WANG X,TANG X.Deep Learning Face Representation from Predicting 10,000 Classes[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR).IEEE ,2014:1891-1898.
[33] HUANG G B,MATTAR M,BERG T,et al.Labeled Faces in the Wild:A Database for Studying Face Recognition in Unconstrained Environments[C]//Proceedings of the Workshop on Faces in ‘Real-Life’ Images:Detection,Alignment,and Recognition.Marseille:INRIA,2008.
[34] GUNTHER M,HU P,HERRMANN C,et al.Unconstrained Face Detection and Open-Set Face Recognition Challenge[C]//Proceedings of the IEEE International Joint Conference on Biometrics.IEEE,2017:697-706.
[35] ZAGORUYKO S,KOMODAKIS N.Wide Residual Networks[J].arXiv:1605.07146,2016.
[36] ZHANG X,ZHOU X,LIN M,et al.ShuffleNet:An Extremely Efficient Convolutional Neural Network for Mobile Devices[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2018:6848-6856.
[37] SANDLER M,HOWARD A,ZHU M,et al.MobileNetV2:Inverted Residuals and Linear Bottlenecks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2018:4510-4520.
[38] TIAN Y,KRISHNAN D,ISOLA P.Contrastive Representation Distillation[C]//Proceedings of the International Conference on Learning Representations.2020:1-19.
[39] HEO B H,KIM J,YUN S D,et al.A Comprehensive Overhaul of Feature Distillation[C]//Proceedings of the IEEE International Conference on Computer Vision.2019:1921-1930.
[40] PARK W,KIM D,LU Y,et al.Relational Knowledge Distil-lation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2019:3967-3976.
[41] SIMONYAN K,ZISSERMAN A.Very Deep Convolutional Networks for Large-Scale Image Recognition[J].arXiv:1409.1556,2014.
[42] WANG H,WANG Y,ZHOU Z,et al.CosFace:Large MarginCosine Loss for Deep Face Recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:5265-5274.
[43] MENG Q,ZHAO S,HUANG Z,et al.MagFace:A UniversalRepresentation for Face Recognition and Quality Assessment[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:14225-14234.
[44] KIM M,CHOI J,KIM D,et al.AdaFace:Quality adaptive margin for face recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.IEEE,2022:18750-18759.
[45] LI P,TU S,XU L.Deep Rival Penalized Competitive Learning for Low-Resolution Face Recognition[J].Neural Networks,2022,148:183-193.
[46] WANG Z,CHANG S,YANG Y,et al.Studying Very Low Re-solution Recognition Using Deep Networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:4792-4800.
[47] SINGH M,NAGPAL S,SINGH R,et al.Dual directed capsule network for very low resolution image recognition[C]//Proceedings of the IEEE International Conference on Computer Vision.2019:340-349.
[1] HU Changyu, FAN Xinyu, ZHANG Zhi, DING Zixu, ZHANG Zhengyue, PENG Juhong. Hierarchical Lightweight Micro-expression Recognition Based on Optical Flow Partitioned FeatureFusion [J]. Computer Science, 2026, 53(8): 174-181.
[2] PING Fengqin, FU Xiaodong. Personalized Federated Learning for Concept and Label Distribution Drift [J]. Computer Science, 2026, 53(7): 433-441.
[3] CHENG Zhirong, XU Yang. FFiT:Faster Frame Interpolation Transformer Based on FasterViT [J]. Computer Science, 2026, 53(7): 34-44.
[4] DING Zhijun, AI Fangju, LIU Aihuan. Document-level Event Argument Extraction Model Based on Hierarchical Dependency Aggregation and Event Enhancement [J]. Computer Science, 2026, 53(7): 156-167.
[5] GU Qinghua, MA Xiang, LI Xuexian. Multi-scale Feature Screening-integrated Lightweight Algorithm for Blast Heap Ore Image Segmentation in Open-pit Mines [J]. Computer Science, 2026, 53(6A): 250500016-8.
[6] LI Siyu, QIAN Wenhua. HCKD:Lightweight Skin Lesion Classification Method Based on Dermoscopic Images [J]. Computer Science, 2026, 53(6A): 250600143-9.
[7] ZHANG Shouyi, SHEN Qiang, GUO Yiran, WANG Hanyu. Rain and Fog Weather Object Detection Algorithm Based on Improved YOLOv8 Model [J]. Computer Science, 2026, 53(6A): 250300090-7.
[8] FU Shiqi, ZHU Jinxia, XU Qichen, DU Zeyu. Dynamic Sparsity and Heterogeneous Knowledge Distillation for Top-k Recommendation [J]. Computer Science, 2026, 53(6A): 250700121-9.
[9] SUN Jing, WANG Yi, CHEN Haiyan. Research on Hierarchical Fountain Codes for Multi-Availability-Zone Cloud Storage [J]. Computer Science, 2026, 53(6): 367-375.
[10] LI Minbo, WANG Shaohua, WU Dazhen. Data Resource Organization Method Based on Enterprise Dataspace and Data Asset Management [J]. Computer Science, 2026, 53(5): 119-128.
[11] PAN Jiahao, FENG Xiang, YU Huiqun. SM-PHT:Robust,Scalable,and Efficient Method for Multi-task Reinforcement Learning [J]. Computer Science, 2026, 53(4): 366-376.
[12] WU Qiaorui, LUO Li, ZHAO Cairong. LLM-augmented Training Framework with Cycle-Consistency Constraints [J]. Computer Science, 2026, 53(4): 377-383.
[13] WANG Pan, WANG Ji, ZHONG Zhengyi, BAO Weidong, ZHANG Yaohong. Lightweight Federated Continual Learning Method Based on Double Anti-forgetting Mechanism [J]. Computer Science, 2026, 53(4): 424-434.
[14] LI Jing, DU Shengdong, SHI Haochen, HU Jie, YANG Yan, LI Tianrui. Pre-trained Spatio-Temporal Decoupling-based Traffic Flow Prediction Model [J]. Computer Science, 2026, 53(4): 155-162.
[15] SONG Jianhua, LIU Chun, ZHANG Yan. Lightweight Camouflaged Object Detection Model Based on Structured Knowledge Distillation [J]. Computer Science, 2026, 53(4): 299-307.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!