计算机科学 ›› 2014, Vol. 41 ›› Issue (8): 241-244.doi: 10.11896/j.issn.1002-137X.2014.08.051

• 人工智能 • 上一篇    下一篇

稀疏约束下非负矩阵分解的增量学习算法

王万良,蔡竞   

  1. 浙江工业大学计算机科学与技术学院 杭州310023;浙江工业大学计算机科学与技术学院 杭州310023
  • 出版日期:2018-11-14 发布日期:2018-11-14
  • 基金资助:
    本文受国家自然科学基金(61070043)资助

Incremental Learning Algorithm of Non-negative Matrix Factorization with Sparseness Constraints

WANG Wan-liang and CAI Jing   

  • Online:2018-11-14 Published:2018-11-14

摘要: 非负矩阵分解(NMF)是一种有效的子空间降维方法。为了改善非负矩阵分解运算规模随训练样本增多而不断增大的现象,同时提高分解后数据的稀疏性,提出了一种稀疏约束下非负矩阵分解的增量学习算法,该算法在稀疏约束的条件下利用前一次分解的结果参与迭代运算,在节省大量运算时间的同时提高了分解后数据的稀疏性。在ORL和CBCL人脸数据库上的实验表明了该算法降维的有效性。

关键词: 子空间降维,稀疏约束,非负矩阵分解,增量学习

Abstract: Non-negative matrix factorization is a useful method of subspace dimensionality reduction.However,with the increasing of training samples,the computing scale of non-negative matrix factorization increases rapidly.To solve this problem and improve the sparseness of the data obtained after factorization as well,an incremental learning algorithm of non-negative matrix factorization with sparseness constraints was proposed in this paper.Using the results of previous factorization involved in iterative computation with sparseness constraints,the cost of the computation is reduced and the sparseness of data after factorization is highly improved.Experimental results on both ORL and CBCL face databa-ses show that the proposed method is effective on dimensionality reduction.

Key words: Subspace dimensionality reduction,Sparseness constraints,Non-negative matrix factorization,Incremental learning

[1] Powell W B.Approximate Dynamic Programming:Solving the Curses of Dimensionality[M].New York:John Wiley & Sons,2007:92-99
[2] Turk M,Pentland A.Eigen faces for recognition[J].Journal of Cognitive Neuroscience,1991,3(1):71-86
[3] Bartlett M S,Lades H M,Sejnowski T J.Independent compo-nent representations for face recognition[C]∥Proceedings of The International Society for Optical Engineering.San Jose,1998,2399(3):528-539
[4] Lee D,Seung H S.Learning the parts of objects by non-negative matrix factorization[J].Nature,1999,401(6755):788-791
[5] Lee D,Seung H S.Algorithms for non-negative matrix factorization[C]∥Processings of Advances in Neural Information Processing Systems.Vancouver,2000:556-562
[6] Hoyer P O.Non-negative sparse coding[C]∥Processings ofIEEE Workshop on Neural Network for Signal Processing,Martigny.2002:557-565
[7] Hoyer P O.Non-negative matrix factorization with sparsenessconstrains[J].Journal of Machine Learning Research,2004,5(9):1457-1469
[8] Bucak S S,Günsel B.Incremental subspace learning via non-negative matrix factorization[J].Pattern Recognition,2009,42(5):788-797
[9] Guan Nai-yang,Tao Da-cheng,Luo Zhi-gang,et al.Online nonnegative matrix factorization with robust stochastic approximation[J].IEEE Transactions on Neural Networks and Learning Systems,2012,23(7):1087-1099
[10] 姜伟,李宏,余震国,等.稀疏约束图正则非负矩阵分解[J].计算机科学,2013,40(1):218-220,6
[11] 史加荣,焦李成,尚凡华.不完全非负矩阵分解的加速算法[J].电子学报,2011,39(2):291-295
[12] 同鸣,张伟,张建龙,等.一种基于部分基矩阵稀疏约束非负矩阵分解的抵抗大强度剪切攻击视频水印构架[J].电子与信息学报,2012,34(8):1819-1826
[13] 施蓓琦,刘春,孙伟伟,等.应用稀疏非负矩阵分解聚类实现高光谱影像波段的优化选择[J].测绘学报,2013,42(3):351-358
[14] 方蔚涛,马鹏,成正斌,等.二维投影非负矩阵分解算法及其在人脸识别中的应用[J].自动化学报,2012,38(9):1503-1512
[15] Liu Xu,Liu Tiao-tiao,Bai Wen-wen,et al.Encoding of rat work-ing memory by power of multi-channel local field potentials via sparse non-negative matrix factorization[J].Neurosci Bull,2013,29(3):279-286
[16] Guan Nai-yang,Zhang Xiang,Luo Zhi-gang,et al.Sparse representation based discriminative canonical correlation analysis for face recognition[C]∥Processings of International Conference on Machine Learning and Applications.Boca Raton,2012:51-56

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!