Computer Science ›› 2026, Vol. 53 ›› Issue (9): 261-270.doi: 10.11896/jsjkx.260600084

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Test-time Adaptive Framework with Dynamic Collaboration for Long-tailed Visual Recognition

LIU Xiaoyan1, CHENG Chunhuai2, ZHANG Yunfeng1, BAO Fangxun3   

  1. 1 School of Computer Science and Artificial Intelligence,Shandong University of Finance and Economics,Jinan 250014,China
    2 Shandong Provincial Education Admissions Examination Institute,Jinan 250014,China
    3 School of Mathematics,Shandong University,Jinan 250014,China
  • Received:2026-05-12 Revised:2026-07-03 Online:2026-09-15 Published:2026-09-10
  • About author:LIU Xiaoyan,born in 2000,postgra-duate.Her main research interests include long-tailed visual recognition,test-time adaptation and deep learning.
    ZHANG Yunfeng,born in 1977,Ph.D,professor,doctoral supervisor.His main research interests include computer vision,data analysis,image processing and visual analytics.
  • Supported by:
    Shandong Provincial Innovation Joint Fund(ZR2024LZH00) and National Natural Science Foundation of China(62506209).

Abstract: Real-world visual recognition tasks face dual challenges during training and testing:training data usually exhibit a pronounced long-tailed distribution,which causes models to be biased toward head classes;meanwhile,in test-agnostic scenarios,the class distribution at test time is typically unknown and may change dynamically,making it difficult for traditional methods that rely on test priors or static aggregation to maintain stable performance.Existing multi-expert methods still suffer from coarse-grained expert specialization,excessive test-time adaptation parameters,and low routing efficiency for tail classes.To address these issues,this paper proposes a test-time adaptive framework with dynamic collaboration for long-tailed visual recognition,termed Dynamic Collaborative Framework(DCF).The proposed method adopts a shared backbone network with multiple micro-expert heads to improve specialization across different class regions through fine-grained expert modeling;meanwhile,it designs a group-wise training objective with prior correction and incorporates prediction-level diversity regularization as well as classifier-head orthogonality regularization to promote dynamically collaborative complementary representations among experts.At test time,it further introduces a lightweight test-time adaptation mechanism that optimizes only group-level aggregation weights,enabling dynamic adaptation to unknown test distributions without updating the backbone network or expert parameters;in addition,a fast aggregation variant based on group prototypes is developed to balance inference efficiency.Experiments on multiple mainstream long-tailed recognition benchmark datasets show that the proposed method achieves or surpasses existing state-of-the-art methods under most test distributions and exhibits stronger robustness,particularly in tail-biased scenarios.Ablation studies further verify the effectiveness of the expert collaboration design,dual regularization,and test-time self-supervised optimization.

Key words: Long-tailed recognition, Test-agnostic, Dynamic collaboration, Test-time adaptation, Micro-experts

CLC Number: 

  • TP391
[1] RUSSAKOVSKY O,DENG J,SU H,et al.ImageNet large scale visual recognition challenge[J].International Journal of Computer Vision,2015,115(3):211-252.
[2] ZHOU B,LAPEDRIZA A,KHOSLA A,et al.Places:A 10 million image database for scene recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,40(6):1452-1464.
[3] WEI X C.Progress and approaches in long-tailed image recognition[J].China Basic Science,2023(5):50-57.
[4] GAO J,CHEN J,FU H,et al.Dynamic mixup for multi-label long-tailed food ingredient recognition[J].IEEE Transactions on Multimedia,2022,25:4764-4773.
[5] LI M,HU Z,LU Y,et al.Feature fusion from head to tail for long-tailed visual recognition[C] //Proceedings of the AAAI Conference on Artificial Intelligence.Palo Alto:AAAI Press,2024:13581-13589.
[6] ZHANG M L,ZHANG X Y,WANG C,et al.Towards prior gap and representation gap for long-tailed recognition[J].Pattern Recognition,2023,133:109012.
[7] REN J,YU C,SHENG S,et al.Balanced meta-softmax for long-tailed visual recognition[C] //Advances in Neural Information Processing Systems.Red Hook:Curran Associates,2020,33:4175-4186.
[8] CAO K,WEI C,GAIDON A,et al.Learning imbalanced data-sets with label-distribution-aware margin loss[C] //Advances in Neural Information Processing Systems.Red Hook:Curran Associates,2019:1567-1578.
[9] MENON A K,JAYASUMANA S,RAWAT A S,et al.Long-tail learning via logit adjustment[PP/OL].arXiv(2020-07-14)[2026-08-06].https://arxiv.org/abs/2007.07314.
[10] ZHANG S,LI Z,YAN S,et al.Distribution alignment:A unified framework for long-tail visual recognition[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society Press,2021:2361-2370.
[11] KANG B,LI Y,XIE S,et al.Exploring balanced feature spaces for representation learning[C] //Proceedings of the International Conference on Learning Representations.San Diego:Open-Review.net,2020.
[12] KANG B,XIE S,ROHRBACH M,et al.Decoupling representation and classifier for long-tailed recognition[PP/OL].arXiv(2019-10-21)[2026-08-06].https://arxiv.org/abs/1910.09217.
[13] GONG X,LV J R.Survey of test-time adaptation:From methods to applications[J].Journal of Sichuan Normal University(Natural Science),2025,48(6):711-722.
[14] ZHANG Y,HOOI B,HONG L,et al.Self-supervised aggregation of diverse experts for test-agnostic long-tailed recognition[C] //Advances in Neural Information Processing Systems.Red Hook:Curran Associates,2022:34077-34090.
[15] GUO C,CHEN W,HUANG A,et al.Prototype alignment with dedicated experts for test-agnostic long-tailed recognition[J].IEEE Transactions on Multimedia,2025,27:455-465.
[16] ZHOU L,LI N,YE M,et al.Source-free domain adaptation with class prototype discovery[J].Pattern Recognition,2024,145:109974.
[17] YANG X,CHEN X,LI M,et al.A versatile framework for continual test-time domain adaptation:Balancing discriminability and generalizability[C] //Proceedings of the IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society Press,2024:23731-23740.
[18] SHAZEER N,MIRHOSEINI A,MAZIARZ K,et al.Outra-geously large neural networks:The sparsely-gated mixture-of-experts layer[PP/OL].arXiv(2017-01-23)[2026-08-06].https://arxiv.org/abs/1701.06538.
[19] LEPIKHIN D,LEE H,XU Y,et al.GShard:Scaling giant models with conditional computation and automatic sharding[PP/OL].arXiv(2020-06-30)[2026-08-06].https://arxiv.org/abs/2006.16668.
[20] CAI J,WANG Y,HWANG J N.ACE:Ally complementary experts for solving long-tailed recognition in one-shot[C] //Proceedings of the IEEE/CVF International Conference on Computer Vision.Los Alamitos:IEEE Computer Society Press,2021:112-121.
[21] WANG X,LIAN L,MIAO Z,et al.Long-tailed recognition by routing diverse distribution-aware experts[PP/OL].arXiv(2020-10-05)[2026-08-06].https://arxiv.org/abs/2010.01809.
[22] HONG Y,HAN S,CHOI K,et al.Disentangling label distribution for long-tailed visual recognition[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society Press,2021:6626-6636.
[23] ZHAO Q,DAI Y,LI H,et al.LTGC:Long-tail recognition via leveraging LLMs-driven generated content[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society Press,2024:19510-19520.
[24] ZHAO Q,DAI Y,LIN S,et al.LTRL:Boosting long-tail recognition via reflective learning[C] //Computer Vision-ECCV 2024.Cham:Springer,2024:1-18.
[25] ZHAO S,WEN X,LIU J,et al.Learning from neighbors:Category extrapolation for long-tail learning[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society Press,2025:30483-30492.
[26] LIU Y,YANG L,WANG Y.Long-tailed classification withmulti-granularity semantics[C] //Proceedings of the IEEE/CVF International Conference on Computer Vision.Los Alamitos:IEEE Computer Society Press,2025:4285-4294.
[27] HINTON G,VINYALS O,DEAN J.Distilling the knowledge in a neural network[PP/OL].arXiv(2015-03-09)[2026-08-06].https://arxiv.org/abs/1503.02531.
[28] HEO B,KIM J,YUN S,et al.A comprehensive overhaul of feature distillation[C] //Proceedings of the IEEE/CVF International Conference on Computer Vision.Los Alamitos:IEEE Computer Society Press,2019:1921-1930.
[29] ZHAO B,CUI Q,SONG R,et al.Decoupled knowledge distillation[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society Press,2022:11953-11962.
[30] ZHAO W,ZHU X,GUO K,et al.Grouped knowledge distillation for deep face recognition[C] //Proceedings of the AAAI Conference on Artificial Intelligence.Palo Alto:AAAI Press,2023:3615-3623.
[31] LI J,ZHOU P,XIONG C,et al.Prototypical contrastive learning of unsupervised representations[PP/OL].arXiv(2020-05-11)[2026-08-06].https://arxiv.org/abs/2005.04966.
[32] LI J,XIONG C,HOI S C H.MoPro:Webly supervised learning with momentum prototypes[PP/OL].arXiv(2020-09-17)[2026-08-06].https://arxiv.org/abs/2009.07995.
[33] YANG H M,ZHANG X Y,YIN F,et al.Convolutional prototype network for open set recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2022,44(5):2358-2370.
[34] KRIZHEVSKY A.Learning multiple layers of features from tiny images[D].Toronto:University of Toronto,2009.
[35] LIU Z,MIAO Z,ZHAN X,et al.Large-scale long-tailed recogni-tion in an open world[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Los Ala-mitos:IEEE Computer Society Press,2019:2537-2546.
[36] VAN HORN G,MAC AODHA O,SONG Y,et al.The iNaturalist species classification and detection dataset[C] //Procee-dings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society Press,2018:8769-8778.
[37] ZHU J,WANG Z,CHEN J,et al.Balanced contrastive learning for long-tailed visual recognition[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society Press,2022:6908-6917.
[38] ZHONG Z,CUI J,LIU S,et al.Improving calibration for long-tailed recognition[C] //Proceedings of the IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society Press,2021:16489-16498.
[39] LI T,CAO P,YUAN Y,et al.Targeted supervised contrastive learning for long-tailed recognition[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Los Alamitos:IEEE Computer Society Press,2022:6918-6928.
[40] HOU C,ZHANG J,WANG H,et al.Subclass-balancing cont-rastive learning for long-tailed recognition[C] //Proceedings of the IEEE/CVF International Conference on Computer Vision.Los Alamitos:IEEE Computer Society Press,2023:5372-5384.
[41] ALEXANDRIDIS K,LUO S,NGUYEN A,et al.Inverse image frequency for long-tailed image recognition[J].IEEE Transactions on Image Processing,2023,32:5721-5736.
[1] HE Jiaojun, LI Xin. Review of Graph Learning Based on Large Language Models:Methods,Benchmarks and Advances [J]. Computer Science, 2026, 53(9): 1-15.
[2] AN Ran, CHENG Kai, SHAO Tianhao, LI Changyuan, CHEN Yan. Framework,Techniques and Challenges of Task Planning Agent Based on Large Language Model [J]. Computer Science, 2026, 53(9): 24-37.
[3] XIA Yi, ZHOU Gang, ZHANG Kaixiang, LAN Mingjing, LI Zhufeng, SU Benrong, HE Haofeng, FENG Shizhong. Survey on Collaborative-driven Knowledge Reasoning Technologies Integrating Large Language Models and Knowledge Graphs [J]. Computer Science, 2026, 53(9): 38-54.
[4] GUO Yuyang, SHI Lei, LIU Huan, DONG Yixiang, LI Rui. Domain-adapted and Dynamically Retrieval-augmented Approach for Large-scale History Discipline Model Construction [J]. Computer Science, 2026, 53(9): 92-100.
[5] XU Jianjun, BI Ying, CHEN Mingming, LIANG Jing. Survey of Molecular Pre-training Models and Their Applications in Drug Discovery [J]. Computer Science, 2026, 53(9): 110-123.
[6] HU Yihui, LI Yan, GUO Tianxiang, LI Wentao, HU Xingchen. Ship Recognition Methods via Rule Construction from Distributed Incomplete Data [J]. Computer Science, 2026, 53(9): 136-144.
[7] WANG Xingyue, YE Hongting, XU Honghua, ZHOU Suyang, KONG Youyong. Multimodal Renewable Energy Data Feature Graph Modeling Method Based on Hard Prompts [J]. Computer Science, 2026, 53(9): 145-156.
[8] LIU Xinlin, WU Keqiang, XU Chang, LI Xiao. Research on Collaborative Ranging Method for Moving Targets Based on Decentralized Multi-view Visual Baseline [J]. Computer Science, 2026, 53(9): 180-187.
[9] YANG Yixuan, WANG Weiming, YANG Zhouwang. Efficient GPU-parallel Algorithm for B-spline Curve Offsetting [J]. Computer Science, 2026, 53(9): 188-195.
[10] YANG Gang, LU Tianliang, ZHANG Peiyuan. MSBF-Net:Multi-modal Synergistic Fusion Method for Image Manipulation Detection and Localization [J]. Computer Science, 2026, 53(9): 196-208.
[11] HE Yuhuang, WANG Qianlei DAI Yuntong DU Wu, QIN Xiaolin. Six Degrees of Freedom Pose Estimation Method Fusing Spectral and Geometric Features [J]. Computer Science, 2026, 53(9): 209-218.
[12] XU Hailun, KANG Hongmei. Subdivision Isogeometric Collocation Based on Cotangent Laplacian [J]. Computer Science, 2026, 53(9): 219-227.
[13] LI Xiaoyu, HAO Yingguang, WANG Hongyu. Infrared and Visible Image Fusion Method Based on Dual Feature Compensation and IlluminationEnhancement [J]. Computer Science, 2026, 53(9): 228-239.
[14] WANG Pengfei, GUO Qinghao, ZENG Qiong, CHEN Shuangmin, XIN Shiqing , TU Changhe. Efficient Approximate Point-to-Mesh Distance Query via Sampling Proxies and Dynamic Programming [J]. Computer Science, 2026, 53(9): 240-248.
[15] DAI Yeqing, WANG Chunxue, DENG Chongyang. 3D Point Cloud Part Segmentation via Symmetry Prior and Co-training Multiview Subspace Clustering [J]. Computer Science, 2026, 53(9): 249-260.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!