Computer Science ›› 2017, Vol. 44 ›› Issue (3): 51-54.doi: 10.11896/j.issn.1002-137X.2017.03.013

Previous Articles     Next Articles

Parallel Algorithm of Nonnegative Matrix Factorization Based on Hybrid MPI and OpenMP Programming Model

TANG Bing, Laurent BOBELIN and HE Hai-wu   

  • Online:2018-11-13 Published:2018-11-13

Abstract: Nonnegative matrix factorization (NMF) has been introduced as an efficient way to reduce the complexity of data and extracting character,and it has also been applied to various fields,such as recommendations and text clustering.However,the computation process of NMF is quite complex.In order to solve this problem,a hybrid parallel hierar-chical NMF algorithm based on OpenMP and MPI was presented in this paper,which makes full use of the advantages of both MPI-based message passing model and OpenMP-based shared storage model.The new algorithm is evaluated in a multi-core cluster environment,and experimental results demonstrate that it can achieve a high speed-up,and can be used to deal with large-scale NMF with a high efficiency.

Key words: Nonnegative matrix factorization,Parallel algorithm,MPI,OpenMPI,Scalability

[1] LEE D,SEUNG H.Learning the Parts of Objects by Nonnegative Matrix Factorization[J].Nature,1999,401:788-791.
[2] KOREN Y,BELL R,VOLINSKY C.Matrix Factorization Tech-niques for Recommender Systems[J].IEEE Computer,2009,42(8):40-49.
[3] CHEN Y,REGE M,DONG M,et al.Non-negative matrix factorization for semi-supervised data clustering[J].Knowledge and Information Systems,2008,17(3):355-379.
[4] CHOO J,LEE C,REDDY C,et al.UTOPIAN:User-Driven TopicModeling Based on Interactive Nonnegative Matrix Factorization[J].IEEE Transactions on Visualization and Computer Graphi-cs,2013,19(12):1992-2001.
[5] WANG W.Instantaneous Versus Convolutive Non-NegativeMatrix Factorization:Models,Algorithms and Applications to Audio Pattern Separation[M]∥Machine Audition:Principles,Algorithms and Systems.IGI Global,2010:353-370.
[6] LIAO R,ZHANG Y,GUAN J,et al.CloudNMF:A MapReduce Implementation of Nonnegative Matrix Factorization for Large-scale Biological Datasets[J].Genomics,Proteomics & Bioinformatics,2014,12(1):48-51.
[7] REN X X,TANG L,LI R F,et al.Study and Implementation of OpenMP Multi-thread Load Balance Scheduling Scheme[J].Computer Science,2010(11):148-151.(in Chinese) 任小西,唐玲,李仁发,等.OpenMP多线程负载均衡调度策略研究与实现[J].计算机科学,2010(11):148-151.
[8] FENG Y,ZHOU S Q.Research on development of mixed mode MPI+OpenMP applications[J].Computer Systems & Applications,2006,15(2):86-89.(in Chinese) 冯云,周淑秋.MPI+OpenMP 混合并行编程模型应用研究[J].计算机系统应用,2006,15(2):86-89.
[9] PAN W,CHEN L Y,ZHANG J H,et al.Research on MPI+OpenMP hybrid programming paradigm based on SMP cluster[J].Application Research of Computers,2009,26(12):4592-4594.(in Chinese) 潘卫,陈燎原,张锦华,等.基于SMP集群的MPI+OpenMP混合编程模型研究[J].计算机应用研究,2009,26(12):4592-4594.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!