Computer Science ›› 2014, Vol. 41 ›› Issue (5): 283-287.doi: 10.11896/j.issn.1002-137X.2014.05.060

Previous Articles     Next Articles

Classification Oriented Criterion Based Dimensionality Reduction and its Application in Face Recognition

YIN Fei and JIAO Li-cheng   

  • Online:2018-11-14 Published:2018-11-14

Abstract: To tackle the problem of the curse of dimensionality caused by high dimensional data,a classification oriented criterion based dimensionality reduction method was presented.The proposed criterion aims at making each training sample and samples from the same class as close as possible in the feature space and making each training sample and samples from the different classes as distant as possible in the feature space.First,for each training sample,weighted average distance of samples from the same class and weighted average distance of samples from different classes were defined.Then,based on these two concepts,total distance of samples from the same class and total distance of samples from different classes were defined.After that,Classification Oriented Criterion (COC) was proposed,which aims at minimizing the total distance of samples from the same class and maximizing the total distance of samples from different classes.Finally,a novel dimensionality reduction method based on COC was presented.The experiments on publicly available face databases ORL and Yale demonstrate that the proposed method outperforms representative dimensionality reduction methods.

Key words: Dimensionality reduction,Total distance of samples from the same class,Total distance of samples from different classes,Classification oriented criterion,Face recognition

[1] Bishop C M.Pattern Recognition and Machine Learning [M].New York:Springer,2006
[2] Jolliffe I T.Principal Component Analysis [M].New York:Springer,1986
[3] Fukunaga K.Introduction to Statistical Pattern Recognition(Second edition)[M]. New York:Academic Press,1990
[4] He X,Niyogi P.Locality preserving projections [C]∥Procee-dings of the Advances in Neural Information Processing Systems (NIPS) 16.2003:585-591
[5] He X,Cai D,Yan S,et al.Neighborhood preserving embedding [C]∥Proceeding of the IEEE International Conference on Computer Vision (ICCV).2005:1208-1213
[6] Li H F,Jiang T,Zhang K S.Efficient and robust feature extraction by maximum margin criterion [J].IEEE Transactions on Neural Networks,2006,17(1):157-165
[7] Yan S C,Xu D,Zhang B Y,et al.Graph embedding and extensions:A general framework for dimensionality reduction [J].IEEE Transactions on pattern Analysis and Machine Intelligence,2007,29(1):40-51
[8] 林玉娥,李敬兆,梁兴柱,等.边界近邻零空间鉴别分析[J].计算机科学,2013,40(3):291-294
[9] Cheng H,Liu Z,Yang L,et al.Sparse representation and lear-ning in visual recognition:theory and applications [J].Signal Processing,2013,93(6):1408-1425
[10] Wright J,Ma Y,Mairal J,et al.Sparse representation for computer vision and pattern recognition [J].Proceedings of the IEEE,2010,98(6):1031-1044
[11] 殷飞,焦李成.基于旋转扩展和稀疏表示的鲁棒遥感图像目标识别[J].模式识别与人工智能,2012,25(1):89-95
[12] Qiao L,Chen S,Tan X.Sparsity preserving projections with applications to face recognition [J].Pattern Recognition,2010,43(1):331-341
[13] Zang F,Zhang J.Discriminative learning by sparse representation for classification [J].Neurocomputing,2011,74(12/13):2176-2183
[14] Yin F,Jiao L C,Shang F,et al.Fast fisher sparsity preserving projections [J].Neural Computing and Applications,2013,23(3/4):691-705
[15] Turk M A,Pentland A P.Eigenfaces for recognition [J].Journal of Congnitive Neuroscience,1991,3(1):71-86
[16] Belhumeur P N,Hespanha J,Kriegman D.Eigenfaces vs.Fisherfaces:recognition using class specific linear projection [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1997,19(7):711-720
[17] 高翠珍,胡建龙,李德玉.保持局部邻域关系的增量Hessian LLE算法[J].计算机科学,2012,39(4):217-219
[18] Belkin M,Niyogi P.Laplacian eigenmaps for dimensionality reduction and data representation [J].Neural Computation,2003,19(7):1373-1396
[19] Roweis S,Saul L.Nonlinear dimensionality reduction by locally linear embedding [J].Science,2000,290(5500):2323-2326
[20] Tao Y,Yang J.Quotient vs.difference:comparison between the two discriminant criteria [J].Neurocomputing,2010,73(10-12):1808-1817
[21] Wang H,Yan S,Xu D,et al.Trace ratio vs.ratio trace for dimensionality reduction [C]∥Proceeding of the IEEE Confe-rence on Computer Vision and Pattern Recognition (CVPR).2007:1-8
[22] Olivetti Oracle Research Lab (ORL) Database [EB/OL].http://www.cl.cam.ac.uk/research/dt-g/attarchive/facedatabase.html
[23] He X,Yan S,Hu Y,et al.Face recognition using laplacianfaces [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2005,27(3):328-340

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!