Computer Science ›› 2026, Vol. 53 ›› Issue (4): 299-307.doi: 10.11896/jsjkx.250100105

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Lightweight Camouflaged Object Detection Model Based on Structured Knowledge Distillation

SONG Jianhua1,3,4, LIU Chun2, ZHANG Yan2,3   

  1. 1 School of Cyber Science and Technology, Hubei University, Wuhan 430062, China
    2 School of Computer Science and Information Engineering, Hubei University, Wuhan 430062, China
    3 Key Laboratory of Intelligent Sensing System and Security, Ministry of Education, Wuhan 430062, China
    4 Hubei Engineering Research Center of Cyber Security for Intelligent Connected Vehicles, Wuhan 430062, China
  • Received:2025-01-16 Revised:2025-03-28 Online:2026-04-15 Published:2026-04-08
  • About author:SONG Jianhua,born in 1973,Ph.D,professor,postgraduate supervisor,is a member of CCF(No.27785M).Her main research interests include network and information security.
    ZHANG Yan,born in 1974,Ph.D,professor,doctoral supervisor.His main research interests include code security and so on.
  • Supported by:
    National Natural Science Foundation of China(62377009),Major Project of Hubei Province(JD)(2023BAA018),Key Project of Hubei Provincial Key R & D Program(2021BAA184,2021BAA188),Research Center for Performance Evaluation and Information Management of Key Research Bases for Humanities and Social Sciences in Hubei Provincial Colleges and Universities(2020JX01) and Major Science and Technology Special Project of Hubei Science and Technology Plan(2024BAA008).

Abstract: Camouflaged object detection(COD) plays a crucial role in natural scene analysis and security monitoring.However,the complexity and diversity of camouflaged objects pose significant challenges to the performance of detection models.Existing knowledge distillation methods are primarily used for model compression by aligning the output features of teacher and student networks to achieve lightweight models.Nonetheless,these methods often overlook the rich semantic information contained in the intermediate features of teacher networks.Additionally,fixed learning rate strategies struggle to adapt to the significant scale differences between teacher and student models,leading to instability during the distillation process.To address these issues,this paper proposes a lightweight camouflaged object detection model based on structured knowledge distillation.The method leverages structured knowledge to improve the traditional soft and hard label loss calculation,significantly enhancing the distillation performance.Furthermore,the learning rate optimization problem is modeled as an optimization task to stabilize performance fluctuations during the distillation process.Experimental results demonstrate that the proposed method achieves an Sm of 82.9% and 81.0% on the COD10K-V3 and CAMO camouflaged object detection datasets,respectively,while reducing training time to 6.5 hours.

Key words: Knowledge distillation, Camouflaged object detection, Object detection, Structured knowledge, Learning rate

CLC Number: 

  • TP391
[1]FAN D P,JI G P,SUN G L,et al.Camouflaged object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:2777-2787.
[2]HINTON G,VINYALS O,DEAN J.Distilling the knowledge in a neural network[J].arXiv:1503.02531,2015.
[3]CHEN H,WANG Y,XU C,et al.Learning student networksvia feature embedding[J].IEEE Transactions on Neural Networks and Learning Systems,2020,32(1):25-35.
[4]FAN D P,JI G P,CHENG M M,et al.Concealed object detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021,44(10):6024-6042.
[5]WANG K,BI H,ZHANG Y,et al.D2C-Net:A Dual-Branch,Dual-Guidance and Cross-Refine Network for Camouflaged Object Detection[J].IEEE Transactions on Industrial Electronics,2021,69(5):5364-5374.
[6]LYU Y,ZHANG J,DAI Y,et al.Simultaneously localize,segment and rank the camouflaged objects[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:11591-11601.
[7]REN J,HU X,ZHU L,et al.Deep texture-aware features forcamouflaged object detection[J].IEEE Transactions on Circuits and Systems for Video Technology,2021,33(3):1157-1167.
[8]JI G P,FAN D P,CHOU Y C,et al.Deep gradient learning for efficient camouflaged object detection[J].Machine Intelligence Research,2023,20(1):92-108.
[9]SUN Y,WANG S,CHEN C,et al.Boundary-guided camou-flaged object detection[J].arXiv:2207.00794,2022.
[10]ZHANG J,LYU Y,XIANG M,et al.Depth confidence-aware camouflaged object detection[J].arXiv:2106.05608,2021.
[11]ZHONG Y,LI B,TANG L,et al.Detecting camouflaged object in frequency domain[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:4504-4513.
[12]YANG F,ZHAI Q,LI X,et al.Uncertainty-guided transformer reasoning for camouflaged object detection[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2021:4146-4155.
[13]LIU Z,ZHANG Z,TAN Y,et al.Boosting camouflaged object detection with dual-task interactive transformer[C]//2022 26th International Conference on Pattern Recognition(ICPR).IEEE,2022:140-146.
[14]YIN B,ZHANG X,FAN D P,et al.Camoformer:Masked separable attention for camouflaged object detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2024,46(12):10362-10374.
[15]MENG Z,LI J,ZHAO Y,et al.Conditional teacher-studentlearning[C]//2019 IEEE International Conference on Acoustics,Speech and Signal Processing(ICASSP 2019).IEEE,2019:6445-6449.
[16]LI T,LI J,LIU Z,et al.Few sample knowledge distillation for efficient network compression[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:14639-14647.
[17]ROMERO A,BALLAS N,KAHOU S E,et al.Fitnets:Hintsfor thin deep nets[J].arXiv:1412.6550,2014.
[18]GAO M,SHEN Y,LI Q,et al.An embarrassingly simple approach for knowledge distillation[J].arXiv:1812.01819,2018.
[19]ZHOU G,FAN Y,CUI R,et al.Rocket launching:A universal and efficient framework for training well-performing light net[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2018.
[20]ZHU X,GONG S.Knowledge distillation by on-the-fly nativeensemble[C]//Advances in Neural Information Processing Systems.2018.
[21]SI Y H,CHENG Q,HUANG J C.A dynamic multi-teacher setting method for knowledge distillation[J].Computer Science,2025,52(5):241-247.
[22]ZHENG P,GAO D,FAN D P,et al.Bilateral reference for high-resolution dichotomous image segmentation[J].arXiv:2401.03407,2024.
[23]ZHAO H W,WU H,MA K,et al.Image classification frame-work based on knowledge distillation[J].Journal of Jilin University(Engineering and Technology Edition),2024,54(8):2307-2312.
[24]MIRZADEH S I,FARAJTABAR M,LI A,et al.Improvedknowledge distillation via teacher assistant[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:5191-5198.
[25]LOSHCHILOV I,HUTTER F.Sgdr:Stochastic gradient de-scent with warm restarts[J].arXiv:1608.03983,2016.
[26]FAN D P,CHENG M M,LIU Y,et al.Structure-measure:A new way to evaluate foreground maps[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:4548-4557.
[27]ACHANTA R,HEMAMI S,ESTRADA F,et al.Frequency-tuned salient region detection[C]//2009 IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2009:1597-1604.
[28]FAN D P,GONG C,CAO Y,et al.Enhanced-alignment measure for binary foreground map evaluation[J].arXiv:1805.10421,2018.
[29]BORJI A,CHENG M M,JIANG H,et al.Salient object detection:A benchmark[J].IEEE Transactions on Image Proces-sing,2015,24(12):5706-5722.
[30]PANG Y,ZHAO X,XIANG T Z,et al.Zoom in and out:A mixed-scale triplet network for camouflaged object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:2160-2170.
[31]HUANG Z,DAI H,XIANG T Z,et al.Feature shrinkage pyramid for camouflaged object detection with transformers[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:5557-5566.
[32]JIA Q,YAO S,LIU Y,et al.Segment,magnify and reiterate:Detecting camouflaged objects the hard way[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:4713-4722.
[33]HE C,LI K,ZHANG Y,et al.Camouflaged object detectionwith feature decomposition and edge reconstruction[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:22046-22055.
[34]SONG J Y,LUO X Z.A lightweight camouflaged object detection model based on attention mechanism and knowledge distillation[J].Journal of Hubei University(Natural Science Edition),2024,46(5):611-620.
[1] PAN Jiahao, FENG Xiang, YU Huiqun. SM-PHT:Robust,Scalable,and Efficient Method for Multi-task Reinforcement Learning [J]. Computer Science, 2026, 53(4): 366-376.
[2] WU Qiaorui, LUO Li, ZHAO Cairong. LLM-augmented Training Framework with Cycle-Consistency Constraints [J]. Computer Science, 2026, 53(4): 377-383.
[3] ZHAO Binbei, ZHU Li, ZHAO Hongli, LI Yutong. Computer Vision Applications in Rail Transit Systems [J]. Computer Science, 2026, 53(3): 214-224.
[4] HUANG Jing, WANG Teng, LIU Jian, HU Kai, PENG Xin, HUANG Yamin, WEN Yuanqiao. Multimodal Visual Detection for Underwater Sonar Target Images [J]. Computer Science, 2026, 53(2): 227-235.
[5] FAN Jiabin, WANG Baohui, CHEN Jixuan. Method for Symbol Detection in Substation Layout Diagrams Based on Text-Image MultimodalFusion [J]. Computer Science, 2026, 53(1): 206-215.
[6] ZHOU Bingquan, JIANG Jie, CHEN Jiangmin, ZHAN Lixin. EvR-DETR:Event-RGB Fusion for Lightweight End-to-End Object Detection [J]. Computer Science, 2026, 53(1): 153-162.
[7] LI Fangfang, KONG Yuqiu, LIU Yang , LI Pengyue. Co-salient Object Detection Guided by Category Labels [J]. Computer Science, 2026, 53(1): 163-172.
[8] LI Ang, ZHANG Jieyuan, LIU Xunyun. Camouflaged Object Detection for Aerial Images Based on Bidirectional Cross-attentionCross-domain Fusion [J]. Computer Science, 2026, 53(1): 173-179.
[9] JIANG Yunliang, JIN Senyang, ZHANG Xiongtao, LIU Kaining, SHEN Qing. Multi-scale Multi-granularity Decoupled Distillation Fuzzy Classifier and Its Application inEpileptic EEG Signal Detection [J]. Computer Science, 2025, 52(9): 37-46.
[10] DENG Jiayan, TIAN Shirui, LIU Xiangli, OUYANG Hongwei, JIAO Yunjia, DUAN Mingxing. Trajectory Prediction Method Based on Multi-stage Pedestrian Feature Mining [J]. Computer Science, 2025, 52(9): 241-248.
[11] SHEN Tao, ZHANG Xiuzai, XU Dai. Improved RT-DETR Algorithm for Small Object Detection in Remote Sensing Images [J]. Computer Science, 2025, 52(8): 214-221.
[12] LIU Le, XIAO Rong, YANG Xiao. Application of Decoupled Knowledge Distillation Method in Document-level RelationExtraction [J]. Computer Science, 2025, 52(8): 277-287.
[13] LIU Chengzhuang, ZHAI Sulan, LIU Haiqing, WANG Kunpeng. Weakly-aligned RGBT Salient Object Detection Based on Multi-modal Feature Alignment [J]. Computer Science, 2025, 52(7): 142-150.
[14] XU Yongwei, REN Haopan, WANG Pengfei. Object Detection Algorithm Based on YOLOv8 Enhancement and Its Application Norms [J]. Computer Science, 2025, 52(7): 189-200.
[15] ZHANG Hang, WEI Shoulin, YIN Jibin. TalentDepth:A Monocular Depth Estimation Model for Complex Weather Scenarios Based onMultiscale Attention Mechanism [J]. Computer Science, 2025, 52(6A): 240900126-7.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!