Computer Science ›› 2014, Vol. 41 ›› Issue (8): 241-244.doi: 10.11896/j.issn.1002-137X.2014.08.051

Previous Articles     Next Articles

Incremental Learning Algorithm of Non-negative Matrix Factorization with Sparseness Constraints

WANG Wan-liang and CAI Jing   

  • Online:2018-11-14 Published:2018-11-14

Abstract: Non-negative matrix factorization is a useful method of subspace dimensionality reduction.However,with the increasing of training samples,the computing scale of non-negative matrix factorization increases rapidly.To solve this problem and improve the sparseness of the data obtained after factorization as well,an incremental learning algorithm of non-negative matrix factorization with sparseness constraints was proposed in this paper.Using the results of previous factorization involved in iterative computation with sparseness constraints,the cost of the computation is reduced and the sparseness of data after factorization is highly improved.Experimental results on both ORL and CBCL face databa-ses show that the proposed method is effective on dimensionality reduction.

Key words: Subspace dimensionality reduction,Sparseness constraints,Non-negative matrix factorization,Incremental learning

[1] Powell W B.Approximate Dynamic Programming:Solving the Curses of Dimensionality[M].New York:John Wiley & Sons,2007:92-99
[2] Turk M,Pentland A.Eigen faces for recognition[J].Journal of Cognitive Neuroscience,1991,3(1):71-86
[3] Bartlett M S,Lades H M,Sejnowski T J.Independent compo-nent representations for face recognition[C]∥Proceedings of The International Society for Optical Engineering.San Jose,1998,2399(3):528-539
[4] Lee D,Seung H S.Learning the parts of objects by non-negative matrix factorization[J].Nature,1999,401(6755):788-791
[5] Lee D,Seung H S.Algorithms for non-negative matrix factorization[C]∥Processings of Advances in Neural Information Processing Systems.Vancouver,2000:556-562
[6] Hoyer P O.Non-negative sparse coding[C]∥Processings ofIEEE Workshop on Neural Network for Signal Processing,Martigny.2002:557-565
[7] Hoyer P O.Non-negative matrix factorization with sparsenessconstrains[J].Journal of Machine Learning Research,2004,5(9):1457-1469
[8] Bucak S S,Günsel B.Incremental subspace learning via non-negative matrix factorization[J].Pattern Recognition,2009,42(5):788-797
[9] Guan Nai-yang,Tao Da-cheng,Luo Zhi-gang,et al.Online nonnegative matrix factorization with robust stochastic approximation[J].IEEE Transactions on Neural Networks and Learning Systems,2012,23(7):1087-1099
[10] 姜伟,李宏,余震国,等.稀疏约束图正则非负矩阵分解[J].计算机科学,2013,40(1):218-220,6
[11] 史加荣,焦李成,尚凡华.不完全非负矩阵分解的加速算法[J].电子学报,2011,39(2):291-295
[12] 同鸣,张伟,张建龙,等.一种基于部分基矩阵稀疏约束非负矩阵分解的抵抗大强度剪切攻击视频水印构架[J].电子与信息学报,2012,34(8):1819-1826
[13] 施蓓琦,刘春,孙伟伟,等.应用稀疏非负矩阵分解聚类实现高光谱影像波段的优化选择[J].测绘学报,2013,42(3):351-358
[14] 方蔚涛,马鹏,成正斌,等.二维投影非负矩阵分解算法及其在人脸识别中的应用[J].自动化学报,2012,38(9):1503-1512
[15] Liu Xu,Liu Tiao-tiao,Bai Wen-wen,et al.Encoding of rat work-ing memory by power of multi-channel local field potentials via sparse non-negative matrix factorization[J].Neurosci Bull,2013,29(3):279-286
[16] Guan Nai-yang,Zhang Xiang,Luo Zhi-gang,et al.Sparse representation based discriminative canonical correlation analysis for face recognition[C]∥Processings of International Conference on Machine Learning and Applications.Boca Raton,2012:51-56

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!