Computer Science ›› 2014, Vol. 41 ›› Issue (2): 49-54.

Previous Articles     Next Articles

Comparison between Two Approaches of Embedding Spatial Information into Linear Discriminant Analysis

NIU Lu-lu,CHEN Song-can and YU Lu   

  • Online:2018-11-14 Published:2018-11-14

Abstract: No Free Lunch Theorem says that only taking full advantage of learning machine of priori knowledge related to the problem under consideration can have a good learning performance.However,the vectorization of the images used in conventional linear discriminant analysis (LDA) damages the spatial structure of initial images,and restricts the improvement of the learning performance of LDA.Spatially smoothing linear discriminant analysis (SLDA) tries to overcome this problem by introducing the spatial regularization to the objective of LDA,whereas IMage Euclidean Distance Discriminant Analysis (IMEDA) substitutes IMage Euclidean Distance (IMED) for the original Euclidean metric in the objective of LDA to utilize the spatially structure information.This paper attempted to explore the intrinsic link between SLDA and IMEDA:theoretically proved that SLDA is the special case of IMEDA when the sample mean of the data set is zero,analyzed the time complexity and the space complexity of the algorithms.The experiments were conducted to compare SLDA with IMEDA on Yale,AR and FERET face datasets,and the influences of the parameters on perfor-mance of the algorithms were analyzed.

Key words: Linear discriminant analysis,Dimensionality reduction,Spatial structure information,Spatially smooth

[1] Duda R O,Hart P E,Stork D G.Pattern Classification(2nd edition)[M].Wiley-Interscience,Hoboken,NJ,2000
[2] Fisher R A.The Use of Multiple Measurement in Taxonomic Problems[J].Annals of Eugenics,1937,20(1):139-152
[3] Turk M,Pentland A.Eigenfaces for recognition[J].Journal of Cognitive Neuroscience,1991,3(1):71-86
[4] Cai Deng,He Xiao-fei,Hu Yu-xiao,et al.Learning a spatiallysmooth subspace for face recognition[C]∥IEEE Conference on Computer Vision and Pattern Recognition.Minneapolis,USA,2007:1-7
[5] He Xiao-fei,Niyogi P.Locality Preserving Projections[C]∥Proceedings of Neural Information Processing Systems.Vancouver,Canada,2003:153-160
[6] He Xiao-fei,Cai Deng,Yan Shui-cheng,et al.Neighborhood preserving embedding[C]∥Proceedings of the Tenth IEEE International Conference on Computer Vision.Beijing,China,2005:1208-1213
[7] Yan Shui-cheng,Xu Dong,Zhang Ben-yu,et al.Graph embed-ding and extension:A general framework for dimensionality reduction[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2007,29(1):40-51
[8] Belhumeour P N,Hespanha J P,Kriegman D J.Eigenfaces vs.Fisherfaces:Recognition using class specific linear projection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1997,19(7):711-720
[9] Zuo Wang-meng,Liu Lei,Wang Kuan-quan,et al.Spatiallysmooth subspace face recognition using LOG and DOG penalties[C]∥Lecture Notes in Computer Science.Wuhan,China,2009:439-448
[10] Hou Chen-ping,Nie Fei-ping,Zhang Chang-shui,et al.Learning an orthogonal and smooth subspace for image classification[J].IEEE Signal Processing Letters,2009,16(4):303-306
[11] 李勇周,罗大庸,刘少强.空间光滑且完整的子空间学习算法[J].模式识别与人工智能,2009,22(3):400-405
[12] Lu Ji-wen,Tan Yap-peng.A doubly weighted approach for appearance-based subspace learning methods[J].IEEE Transa-tions on Information Forensics and Security,2010,5(1):71-81
[13] Wen Hao,Wen You-kui.Face recognition using spatially smooth and maximum minimum value of manifold preserving[C]∥International Conference on Applied Informatics and Communication.Xi’an,China,2011:194-204
[14] Wang Li-wei,Zhang Yan,Feng Ju-fu.On the Euclidean Distance of Images[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2005,27(5):1334-1339
[15] Li Jun-li,Chen Gang,Chi Zhe-ru.A Fuzzy Image Metric with Application to Fractal Coding[J].IEEE Transactions on Image Processing,2002,11(6):636-643
[16] Simard P,Cun Yan-le,Dender J S.Efficient Pattern Recognition Using a New Transformation Distance[C]∥Advances in Neural Information Processing Systems 5.Denver,CO,USA,1993:50-58
[17] Huttenlocher D P,Klanderman G A,Rucklidge W J.ComparingImages Using the Hausdorff Distance[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1993,15(9):850-863
[18] Chen Jie,Wang Rui-ping,Shan Shi-guang,et al.Isomap based on the image Euclidean distance[C]∥IEEE International Confe-rence on Pattern Recognition.Hong Kong,China,2006:1110-1113
[19] Li Jing,Lu Bao-liang.An adaptive image Euclidean distance[J].Pattern Recognition,2009,42(3):349-357
[20] 黄晓华,梁超,郑文明.图像空间中的鉴别型局部线性嵌入方法[J].中国图象图形学报,2010,15(12):1776-1782
[21] Sun Bing,Feng Ju-fu,Wang Li-wei.Learning IMED via Shift-In-variant transformation[C]∥IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Miami,Florida,USA,2009:1398-1405
[22] Gu Sui-cheng,Tan Ying,He Xin-gui.Laplacian smoothingtransform for face recognition[J].Science China Information Sciences,2010,53(12):2415-2428
[23] Vapnik V.The nature of statistical learning theory[M].NewYork:Springer Verlag,1995:1-50
[24] O’Sullivan Finbarr.Discretized Laplacian Smoothing by FourierMethod [J].Journal of the American Statistical Association,1991,86(415):634-642
[25] Belkin M,Niyogi P.Laplacian eigenmaps and spectral techniques for embedding and clustering[C]∥Proceedings of Advances in MIT Press,Neural Information Processing Systems.MA,USA:2001:585-591
[26] He Xiao-fei,Yan Shui-cheng,Hu Yu-xiao,et al.Face recognitionusing laplacianfaces[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2005,27(3):328-340
[27] Ye Jie-ping,Janardan R,Qi Li.Two-dimensional linear discrimi-nant analysis[C]∥Proceedings of Advances in Neural Information Processing Systems.Vancouver,British,2004:1569-1576
[28] Chen Xiao-hong,Chen Song-can,Xue Hui,et al.A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data[J].Pattern Recognition,2012,45(5):2005-2018

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!