计算机科学 ›› 2020, Vol. 47 ›› Issue (6): 104-113.doi: 10.11896/jsjkx.200200135

• 计算机图形学&多媒体 • 上一篇    下一篇

基于测试样本误差重构的协同表示分类方法

王俊茜1,2, 郑文先3, 徐勇1,2   

  1. 1 哈尔滨工业大学(深圳)计算机科学与技术学院生物计算研究中心 广东 深圳518055
    2 哈尔滨工业大学(深圳)深圳市视觉目标检测与判识重点实验室 广东 深圳518055
    3 清华大学深圳国际研究生院 广东 深圳518055
  • 收稿日期:2020-02-29 出版日期:2020-06-15 发布日期:2020-06-10
  • 通讯作者: 徐勇(laterfall@hit.edu.cn)
  • 作者简介:wangjunqian@stu.hit.edu.cn
  • 基金资助:
    广东省科技计划项目(2018B010108003);深圳市科技创新委员会项目(ZDSYS20190902093015527,JSGG20190220153602271)

Novel Image Classification Based on Test Sample Error Reconstruction Collaborative Representation

WANG Jun-qian1,2, ZHENG Wen-xian3, XU Yong1,2   

  1. 1 Bio-Computing Research Center,College of Computer Science and Technology,Harbin Institute of Technology (Shenzhen),Shenzhen, Guangdong 518055,China
    2 Shenzhen Key Laboratory of Visual Object Detection and Recognition,Harbin Institute of Technology (Shenzhen),Shenzhen, Guangdong 518055,China
    3 Tsinghua Shenzhen International Graduate School,Shenzhen,Guangdong 518055,China
  • Received:2020-02-29 Online:2020-06-15 Published:2020-06-10
  • About author:WANG Jun-qian,born in 1993,Ph.D,candidate,is a member of China Computer Federation.Her main research interests include pattern recognition,computer vision,deep learning and biomedical and image processing.
    XU Yong,born in 1972,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.His main research interests include pattern recognition,computer vision,biomedical ima-ge processing and bioinformatics.
  • Supported by:
    This work was supported by the Guangdong Science and Technology Project (2018B010108003) and Shenzhen Municipal Science and Technology Innovation Council (ZDSYS20190902093015527,JSGG20190220153602271).

摘要: 基于协同表示的分类方法(Collaborative Representation-based Classification,CRC)在诸如人脸识别、物体识别等图像分类任务中取得了良好的效果。CRC利用范数正则化来解决测试样本的线性表示问题,以期得到一个较稳定的数值解。已有研究表明,正则化参数的选择对协同表示的数值稳定性起着非常重要的作用。文中提出了一种新的基于测试样本误差重构的协同表示分类方法 (Test Sample Error Reconstruction Collaborative Representation-based Classification,TSER-CRC)。该方法首先利用较小的正则化参数计算出一个协同表示系数,使其重新构建测试样本,以削弱原始测试样本中的误差或减小原始测试样本与训练样本之间的不一致性;然后,利用较大的正则化参数,并基于重构出的测试样本再次求解协同表示系数,以得出数值较稳定的测试样本与各类别训练样本之间的关系,并以此对测试样本进行分类。该方法有效地减少了由所有训练样本构成的协同子空间所表示的测试样本中存在的误差和异常值,提高了协同表示编码系数的稳定性和图像分类的鲁棒性。通过在5个标准数据集上的实验结果表明,所提方法在图像分类精度方面明显优于传统CRC和其他一些经典的图像分类方法。

关键词: 表示分类, 模式识别, 图像分类, 误差重构, 协同表示

Abstract: Collaborative representation-based classification (CRC) has shown noticeable results on image classification tasks like face recognition and object recognition.It solves a linear problem of the test sample with norm regularization,to obtain a more stable numerical solution.Previous studies have shown that the choice of regularization parameters plays a very important role in the numerical stability of the collaborative representation.This paper proposes a novel image classification method based on test sample error reconstruction collaborative representation-based classification,called TSER-CRC.The first phase of the proposed method uses a smaller regularization parameter to calculate a collaborative representation coefficient and reconstructs the test sample with the obtained coefficient to weaken the error in the original test sample and reduce the inconsistency between the origi-nal test sample and the training samples.The second phase of the proposed method uses the larger regularization parameter and the test samples reconstructed in the first phase to solve the collaborative representation coefficients to obtain the relationship between the numerically stable test sample and the training samples for each class.Finally,the test sample will be classified by conventional classification strategy in CRC.The poposed method can effectively reduce the errors and outliers in the test samples represented by the collaborative subspace composed of all training samples,thereby increasing the stability of the collaborative representation coding coefficients and the robustness of image classification.Experimental results on five standard datasets show that the proposed method can achieve more satisfactory in image classification accuracy than traditional CRC and some others classical image classification methods.

Key words: Collaborative representation, Error reconstruction, Image classification, Pattern recognition, Representation-based classification

中图分类号: 

  • TP391.4
[1]SUN X,NASRABADI N M,TRAN T D.Supervised deep sparse coding networks for image classification[J].IEEE Tran-sactions on Image Processing,2020,29:405-418.
[2]GENG C,HUANG S,CHEN S.Recent advances in open set recognition:A survey[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020.
[3]ZHOU Y,HE X,HUANG L,et al.Collaborative learning of semi-supervised segmentation and classification for medical images[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2019:2079-2088.
[4]KAYABOL K.Approximate sparse multinomial logistic regression for classification[J].The IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,42(2):490-493.
[5]WANG Y,TANG Y Y,LI L,et al.Atomic representation-based classification:theory,algorithm,and applications[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,41(1):6-19.
[6]WEI X,SHEN H,KLEINSTEUBER M.Trace quotient with sparsity priors for learning low dimensional image representations[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2019.
[7]NASEEM I,TOGNERI R,BENNAMOUN M.Linear regression for face recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,32(11):2106-2112.
[8]WRIGHT J,MA Y,MAIRAL J,et al.Sparse representation for computer vision and pattern recognition[J].Proceedings of the IEEE,2010,98(6):1031-1044.
[9]WEN J,FANG X,CUI J,et al.Robust sparse linear discriminant analysis[J].IEEE Transactions on Circuits and Systems for Video Technology,2018,29(2):390-403.
[10]ZHANG X,JIANG J G,HONG R C,et al.Image classification algorithm based on low rank and sparse decomposition and collaborative representation[J].Computer Science,2016,43(7):83-88.
[11]XU J Q,WAN W,LV Q.Classification of hyperspectral remote sensing imagery based on second order moment sparse coding[J].Computer Science,2018,45(9):288-293.
[12]XU Y,ZHANG D,YANG J,et al.A two-phase test sample sparse representation method for use with face recognition[J].IEEE Transactions on Circuits and Systems for Video Technology,2011,21(9):1255-1262.
[13]WEN J,XU Y,LI Z,et al.Inter-class sparsity based discriminative least square regression[J].Neural Networks,2018,102:36-47.
[14] LI G H,LI J J,FAN H.Image denoising algorithm based onadaptive matching pursuit[J].Computer Science,2015,52(4),943-951.
[15]ZHANG L,YANG M,FENG X.Sparse representation or collaborative representation:Which helps face recognition?[C]//International Conference on Computer Vision.IEEE,2011:471-478.
[16]XU Y,ZHU X,LI Z,et al.Using the original and ‘symmetrical face’ training samples to perform representation based two-step face recognition[J].Pattern Recognition,2013,46(4):1151-1158.
[17]HUANG W,WANG X,JIN Z,et al.Penalized collaborative representation based classification for face recognition[J].Applied Intelligence,2015,43(4):722-731.
[18]LIU S,ZHANG X,PENG Y,et al.Virtual images inspired consolidate collaborative representation-based classification method for face recognition[J].Journal of Modern Optics,2016,63(12):1181-1188.
[19]CHENG Y,JIN Z,GAO T,et al.An improved collaborative representation based classification with regularized least square (CRC-RLS) method for robust face recognition[J].Neurocomputing,2016,215:250-259.
[20]XU Y,ZHONG Z,YANG J,et al.A new discriminative sparse representation method for robust face recognition via l2 regularization[J].IEEE transactions on neural networks and learning systems,2016,28(10):2233-2242.
[21]XU Y,ZHANG B,ZHONG Z.Multiple representations and sparse representation for image classification[J].Pattern recognition letters,2015,68:9-14.
[22]WANG J,LIU Y.Multiple representations and sparse representation for color image classification[C]//International Confe-rence on Computing and Pattern Recognition.ACM,2018:78-85.
[23]ZHANG H,YANG J,XIE J,et al.Weighted sparse coding regularized nonconvex matrix regression for robust face recognition[J].Information Sciences,2017,394:1-17.
[24]ZENG S,ZHANG B,LAN Y,et al.Robust collaborative representation-based classification via regularization of truncated total least squares[J].Neural Computing and Applications,2019,31:5689-5697:1-9.
[25]GOEL N,BEBIS G,NEFIAN A.Face recognition experiments with random projection[C]//Biometric Technology for Human Identification II.International Society for Optics and Photonics.SPIE,2005,5779:426-437.
[26]LEARNED-MILLER E,HUANG G B,ROYCHOWDHURY A,et al.Labeled faces in the wild:A survey[M]//Advances in face detection and facial image analysis.Berlin:Springer,2016:189-248.
[27]WANG S J,YANG J,SUN M F,et al.Sparse tensor discriminant color space for face verification[J].IEEE Transactions on Neural Networks and Learning Systems,2012,23(6):876-888.
[28]LI F F,FERGUS R,PERONA P.Learning generative visual models from few training examples:An incremental bayesian approach tested on 101 object categories[J].Computer Vision and Image Understanding,2007,106(1):59-70.
[29]KIM S J,KOH K,LUSTIG M,et al.An interior-point method for large-scale e1-regularized least squares[J].IEEE Journal of Selected Topics in Signal Processing,2007,1(4):606-617.
[30]BECK A,TEBOULLE M.A fast iterative shrinkage-thresholding algorithm for linear inverse problems[J].SIAM Journal on Imaging Sciences,2009,2(1):183-202.
[31]YANG A Y,ZHOU Z,BALASUBRAMANIAN A G,et al.Fast λ1-minimization algorithms for robust face recognition[J].IEEE Transactions on Image Processing,2013,22(8):3234-3246.
[32]YANG A Y,SASTRY S S,GANESH A,et al.Fast λ1-minimization algorithms and an application in robust face recognition:A review[C]//Proc of Int Conf on Image Processing.Pisca-taway,NJ:IEEE,2010:1849-1852.
[33]COVER T M,HART P.Nearest neighbor pattern classification[J].IEEE Transactions on Information Theory,1967,13(1):21-27.
[34]SAMARIA F S,HARTER A C.Parameterisation of a stochastic model for human face identification[C]//1994 IEEE Workshop on Applications of Computer Vision.IEEE,1994:138-142.
[35]HOUBEN S,STALLKAMP J,SALMEN J,et al.Detection of traffic signs in real-world images:The German Traffic Sign Detection Benchmark[C]//The 2013 International JointConfe-rence on Neural Networks.IEEE,2013:1-8.
[1] 武红鑫, 韩萌, 陈志强, 张喜龙, 李慕航.
监督和半监督学习下的多标签分类综述
Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning
计算机科学, 2022, 49(8): 12-25. https://doi.org/10.11896/jsjkx.210700111
[2] 杨健楠, 张帆.
一种结合双注意力机制和层次网络结构的细碎农作物分类方法
Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure
计算机科学, 2022, 49(6A): 353-357. https://doi.org/10.11896/jsjkx.210200169
[3] 杜丽君, 唐玺璐, 周娇, 陈玉兰, 程建.
基于注意力机制和多任务学习的阿尔茨海默症分类
Alzheimer's Disease Classification Method Based on Attention Mechanism and Multi-task Learning
计算机科学, 2022, 49(6A): 60-65. https://doi.org/10.11896/jsjkx.201200072
[4] 朱旭东, 熊贇.
基于样本分布损失的图像多标签分类研究
Study on Multi-label Image Classification Based on Sample Distribution Loss
计算机科学, 2022, 49(6): 210-216. https://doi.org/10.11896/jsjkx.210300267
[5] 彭云聪, 秦小林, 张力戈, 顾勇翔.
面向图像分类的小样本学习算法综述
Survey on Few-shot Learning Algorithms for Image Classification
计算机科学, 2022, 49(5): 1-9. https://doi.org/10.11896/jsjkx.210500128
[6] 张文轩, 吴秦.
基于多分支注意力增强的细粒度图像分类
Fine-grained Image Classification Based on Multi-branch Attention-augmentation
计算机科学, 2022, 49(5): 105-112. https://doi.org/10.11896/jsjkx.210100108
[7] 许华杰, 陈育, 杨洋, 秦远卓.
基于混合样本自动数据增强技术的半监督学习方法
Semi-supervised Learning Method Based on Automated Mixed Sample Data Augmentation Techniques
计算机科学, 2022, 49(3): 288-293. https://doi.org/10.11896/jsjkx.210100156
[8] 董琳, 黄丽清, 叶锋, 黄添强, 翁彬, 徐超.
人脸伪造检测泛化性方法综述
Survey on Generalization Methods of Face Forgery Detection
计算机科学, 2022, 49(2): 12-30. https://doi.org/10.11896/jsjkx.210900146
[9] 陈长伟, 周晓峰.
快速局部协同表示分类器及其在人脸识别中的应用
Fast Local Collaborative Representation Based Classifier and Its Applications in Face Recognition
计算机科学, 2021, 48(9): 208-215. https://doi.org/10.11896/jsjkx.200800155
[10] 陈天荣, 凌捷.
基于特征映射的差分隐私保护机器学习方法
Differential Privacy Protection Machine Learning Method Based on Features Mapping
计算机科学, 2021, 48(7): 33-39. https://doi.org/10.11896/jsjkx.201200224
[11] 胡京徽, 许鹏.
一种基于图像分类的航空紧固件产品自动分类方法
Automatic Classification of Aviation Fastener Products Based on Image Classification
计算机科学, 2021, 48(6A): 63-66. https://doi.org/10.11896/jsjkx.200900163
[12] 刘汉卿, 康晓东, 李博, 张华丽, 冯继超, 韩俊玲.
利用深度学习网络对医学影像分类识别的比较研究
Comparative Study on Classification and Recognition of Medical Images Using Deep Learning Network
计算机科学, 2021, 48(6A): 89-94. https://doi.org/10.11896/jsjkx.201000116
[13] 魏冬, 刘浩, 陈根龙, 宫晓蕙.
基于颜色校正和去模糊的水下图像增强方法
Underwater Image Enhancement Based on Color Correction and Deblurring
计算机科学, 2021, 48(4): 144-150. https://doi.org/10.11896/jsjkx.200800185
[14] 孙文赟, 金忠, 赵海涛, 陈昌盛.
基于深度特征增广的跨域小样本人脸欺诈检测算法
Cross-domain Few-shot Face Spoofing Detection Method Based on Deep Feature Augmentation
计算机科学, 2021, 48(2): 330-336. https://doi.org/10.11896/jsjkx.200100020
[15] 谢海平, 李高源, 杨海涛, 赵洪利.
超分辨率重构遥感图像分类研究
Classification Research of Remote Sensing Image Based on Super Resolution Reconstruction
计算机科学, 2021, 48(11A): 424-428. https://doi.org/10.11896/jsjkx.210300132
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!