Computer Science ›› 2025, Vol. 52 ›› Issue (5): 187-198.doi: 10.11896/jsjkx.240600162

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Open Set Recognition Based on Meta Class Incremental Learning

SUN Jinyong, WANG Xuechun, CAI Guoyong, SHANG Zhiliang   

  1. Guangxi Key Laboratory of Trusted Software,Guilin University of Electronic Technology,Guilin,Guangxi 541004,China
  • Received:2024-06-27 Revised:2024-08-21 Online:2025-05-15 Published:2025-05-12
  • About author:SUN Jinyong,born in 1978,Ph.D,professor,is a member of CCF(No.24794M).His main research interests include machine learning and business process management.WANG Xuechun,born in 1997,master.Her main research interests include machine learning and so on.
  • Supported by:
    National Natural Science Foundation of China(62366010,61862016,62006058, 62066010), Guangxi Key Laboratory of Trusted Software Project(KX202205) and Fund of the Key Laboratory of Cognitive Radio and Information Processing,Ministry of Education(CRKL210107).

Abstract: Traditional image classification algorithms assume that the world is static and closed,whereas the real world is dyna-mic and open,and new categories and their samples are continually emerging,leading to a decrease in the accuracies of traditional image classification algorithms.To address this problem,researchers proposed open set recognition(OSR) problem for the real world which aims at identifying unknown-class samples while maintaining the classification accuracy for known-class samples.However,existing OSR methods generally neglect the further exploitation of identified unknown-class samples and the unknown class samples are scarce in number,so that the classification model is unable to incrementally learn the knowledge of identified unknown class samples,thereby impairing the accuracy and generalization capability of OSR models.Therefore,this paper proposes an OSR method based on meta-incremental learning to improve the accuracy and generalization of OSR models.This method employs a bi-level optimization mechanism to build an OSR model,and then cluster unknown class samples based on deep learning so that the built OSR model can incrementally learn the knowledge of unknown class samples.Specifically,an OSR model based on bi-level optimization mechanism is constructed and trained with few-shot unknown class samples,in order to enable the OSR model to incrementally learn the knowledge of few-shot unknown class samples.Then,a weight excitation attention method is used to obtain the importance of the OSR model's parameters and update non-critical parameters,thereby reducing the impact of incremental learning on the model's ability to classify known-classes.Additionally,a deep learning-based DBSCAN method is designed to extract features and cluster the identified unknown-class samples.Clustered samples are labeled as the same class and performed incremental learning.While samples that are difficult to cluster are rejected,to avoid the impact of too few unknown-class samples on the model's incremental learning effectiveness.Finally,experimental results on four public datasets show that the proposed method outperforms the mainstream open-set recognition methods on AUROC and F1 scores,and adequately learns the knowledge of identified unknown class samples.

Key words: Open set recognition, Image classification, Incremental learning, Meta learning, Clustering

CLC Number: 

  • TP181
[1]ZHAO H W,WU H,MA K,et al.Image classification frame-work based on knowledge distillation.[J].Journal of Jilin University(Engineering and Technology Edition),2024,54(8):2307-2312.
[2]ZHANG H Y,XIA Y L,ZHOU K W,et al.A Method of Multi-label Image Classification with Fusing Powerful Semantic Correlation[J].Journal of Chongqing Technology and Business University(Natural Science Edition),2023,40(5):8-15.
[3]SCHEIRER W J,DE REZENDE ROCHA A,SAPKOTA A,et al.Toward open set recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI),2012,35(7):1757-1772.
[4]ZHOU D W,WANG Q W,QI Z H,et al.Deep class-incremental learning:A survey[J].arXiv:2302.03648,2023.
[5]SCHEIRER W J,JAIN L P,BOULT T E.Probability models for open set recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2014,36(11):2317-2324.
[6]SCHERREIK M D,RIGLING B D.Open set recognition for au-tomatic target classification with rejection[J].IEEE Transactions on Aerospace and Electronic Systems,2016,52(2):632-642.
[7]BENDALE A,BOULT T E.Towards open set deep networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2016:1563-1572.
[8]SHU L,XU H,LIU B.Doc:Deep open classification of text documents[C]//Conference on Empirical Methods in Natural Language Processing.2017:2243-2979.
[9]ZHOU D W,YE H J,ZHAN D C.Learning placeholders foropen-set recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR).2021:4401-4410.
[10]YANG H M,ZHANG X Y,YIN F,et al.Convolutional prototype network for open set recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2022,44(5):2358-2370.
[11]LU J,XU Y,LI H,et al.Pmal:Open set recognition via robust prototype mining[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2022:1872-1880.
[12]GE Z Y,DEMYANOV S,CHEN Z T,et al.Generative openmax for multi-class open set classification[C]//Computer Vision and Pattern Recognition(CVPR).2017.
[13]NEAL L,OLSON M,FERN X,et al.Open set learning withcounterfactual images[C]//Proceedings of the European Conference on Computer Vision(ECCV).2018:613-628.
[14]PERERA P,MORARIU V I,JAIN R,et al.Generative-discriminative feature representations for open-set recognition [C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR).2020:11814-11823.
[15]YANG Y,HOU C P,LANG Y,et al.Open-set human activity recognition based on micro-doppler signatures[J].Pattern Re-cognition,2019,85:60-69.
[16]FENG Q,KANG G,FAN H,et al.Attract or distract:Exploit the margin of open set[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:7990-7999.
[17]KONG S,RAMANAN D.Opengan:Open-set recognition viaopen data generation[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2021:813-822.
[18]GOODFELLOW I,POUGET-ABADIE J,MIRZA M,et al.Ge-nerative adversarial networks[J].Communications of the ACM,2020,63(11):139-144.
[19]DE ROSA R,MENSINK T,CAPUTO B.Online open worldrecognition[J].arXiv:1604.02275,2016.
[20]PRAKHYA S,VENKATARAM V,KALITA J.Open set text classification using CNNs[C]//Proceedings of the 14th International Conference on Natural Language Processing(ICON-2017).2017:466-475.
[21]SHU Y,SHI Y,WANG Y,et al.P-odn:Prototype-based open deep network for open set recognition[J].Scientific Reports,2020,10(1):7146.
[22]DANG S,CAO Z,CUI Z,et al.Open set incremental learning for automatic target recognition[J].IEEE Transactions on Geo-science and Remote Sensing,2019,57(7):4445-4456.
[23]GAO F,YANG L,LI H.A survey on open set recognition[J].Journal of Nanjing University(Natural Sciences),2022,58(1):115-134.
[24]BENDALE A,BOULT T.Towards open world recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2015:1893-1902.
[25]GENG C,HUANG S,CHEN S.Recent advances in open setrecognition:A survey[J].IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI),2020,43(10):3614-3631.
[26]DE LANGE M,ALJUNDI R,MASANA M,et al.A continual learning survey:Defying forgetting in classification tasks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021,44(7):3366-3385.
[27]TAO X,HONG X,CHANG X,et al.Few-shot class-incremental learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:12183-12192.
[28]HOSPEDALES T,ANTONIOU A,MICAELLI P,et al.Meta-learning in neural networks:A survey[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021,44(9):5149-5169.
[29]FINN C,ABBEEL P,LEVINE S.Model-agnostic meta-learning for fast adaptation of deep networks[C]//International Confe-rence on Machine Learning.PMLR,2017:1126-1135.
[30]SUN J Y,WANG X C,SUN Z G,el at.Prototype Contrastive Learning for Open Set Recognition[J].Journal of Chinese Computer Systems,2024,45(7):1671-1678.
[31]YANN L C,DENKER J,SOLLA S.Optimal brain damage[J].Advances in Neural Information Processing Systems,1989,2:598-605.
[32]KIRKPATRICK J,PASCANU R,RABINOWITZ N,et al.Overcoming catastrophic forgetting in neural networks[J].Proceedings of the National Academy of Sciences,2017,114(13):3521-3526.
[33]CHI Z,GU L,LIU H,et al.Metafscil:A meta-learning approach for few-shot class incremental learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:14166-14175.
[34]QUADER N,BHUIYAN M M I,LU J,et al.Weight excitation:Built-in attention mechanisms in convolutional neural networks[C]//Computer Vision.2020:87-103.
[35]SUN J Y,ZHOU B W,WEN L J,et al.Anomaly detection of business processes based on attention mechanism[J].Computer Integrated Manufacturing Systems,2022,28(10):3039-3051.
[36]CARON M,BOJANOWSKI P,JOULIN A,et al.Deep cluste-ring for unsupervised learning of visual features[C]//Procee-dings of the European Conference on Computer Vision(ECCV).2018:132-149.
[37]OZA P,PATEL V M.C2ae:Class conditioned auto-encoder for open-set recognition[C]//Procee-dings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR).2019:2307-2316.
[1] SUN Tanghui, ZHAO Gang, GUO Meiqian. Long-tail Distributed Medical Image Classification Based on Large Selective Nuclear Bilateral-branch Networks [J]. Computer Science, 2025, 52(4): 231-239.
[2] WANG Yifei, ZHANG Shengjie, XUE Dizhan, QIAN Shengsheng. Self-supervised Backdoor Attack Defence Method Based on Poisoned Classifier [J]. Computer Science, 2025, 52(4): 336-342.
[3] AN Rui, LU Jin, YANG Jingjing. Deep Clustering Method Based on Dual-branch Wavelet Convolutional Autoencoder and DataAugmentation [J]. Computer Science, 2025, 52(4): 129-137.
[4] WU Jie, WAN Yuan, LIU Qiujie. Consistent Block Diagonal and Exclusive Multi-view Subspace Clustering [J]. Computer Science, 2025, 52(4): 138-146.
[5] TIAN Qing, KANG Lulu, ZHOU Liangyu. Class-incremental Source-free Domain Adaptation Based on Multi-prototype Replay andAlignment [J]. Computer Science, 2025, 52(3): 206-213.
[6] SHEN Yaxin, GAO Lijian , MAO Qirong. Semi-supervised Sound Event Detection Based on Meta Learning [J]. Computer Science, 2025, 52(3): 222-230.
[7] XIE Jiachen, LIU Bo, LIN Weiwei , ZHENG Jianwen. Survey of Federated Incremental Learning [J]. Computer Science, 2025, 52(3): 377-384.
[8] ZHANG Manjing, HE Yulin, LI Xu, HUANG Zhexue. Distributed Two-stage Clustering Method Based on Node Sampling [J]. Computer Science, 2025, 52(2): 134-144.
[9] XIN Yongjie, CAI Jianghui, HE Yanting, SU Meihong, SHI Chenhui, YANG Haifeng. Multi-view Clustering Based on Cross-structural Feature Selection and Graph Cycle AdaptiveLearning [J]. Computer Science, 2025, 52(2): 145-157.
[10] ZHANG Xin, ZHANG Han, NIU Manyu, JI Lixia. Adversarial Sample Detection in Computer Vision:A Survey [J]. Computer Science, 2025, 52(1): 345-361.
[11] DING Xinyu, KONG Bing, CHEN Hongmei, BAO Chongming, ZHOU Lihua. Path-masked Autoencoder Guiding Unsupervised Attribute Graph Node Clustering [J]. Computer Science, 2025, 52(1): 160-169.
[12] ZHOU Yu, YANG Junling, DANG Kelin. Change Detection in SAR Images Based on Evolutionary Multi-objective Clustering [J]. Computer Science, 2024, 51(9): 140-146.
[13] LI Zekai, ZHONG Jiaqing, FENG Shaojun, CHEN Juan, DENG Rongyu, XU Tao, TAN Zhengyuan, ZHOU Kexing, ZHU Pengzhi, MA Zhaoyang. CPU Power Modeling Accuracy Improvement Method Based on Training Set Clustering Selection [J]. Computer Science, 2024, 51(9): 59-70.
[14] WANG Yiyang, LIU Fagui, PENG Lingxia, ZHONG Guoxiang. Out-of-Distribution Hard Disk Failure Prediction with Affinity Propagation Clustering and Broad Learning Systems [J]. Computer Science, 2024, 51(8): 63-74.
[15] WANG Xingeng, DU Tao, ZHOU Jin, CHEN Di, WU Yunzheng. Adaptive Density Peak Clustering Algorithm Based on Shared Nearest Neighbor [J]. Computer Science, 2024, 51(8): 97-105.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!