Computer Science ›› 2019, Vol. 46 ›› Issue (6): 64-68.doi: 10.11896/j.issn.1002-137X.2019.06.008

Previous Articles     Next Articles

Multi-type Relational Data Co-clustering Approach Based on Manifold Regularization

HUANG Meng-ting, ZHANG Ling, JIANG Wen-chao   

  1. (School of Computers,Guangdong University of Technology,Guangzhou 510006,China)
  • Received:2018-05-06 Published:2019-06-24

Abstract: With the development of big data applications,the size of multi-type relational data sampled from nonlinear manifolds is getting larger.The data geometric structure is more complicated,and the heterogeneous relational data are becoming extremely sparse.As a result,data mining becomes more difficult and less accurate.In order to solve this problem,this paper proposed a manifold nonnegative matrix tri-factorization(MNMTF) approach for multi-type relational data co-clustering.First of all,the correlation matrix is constructed with the natural relationship or content relevance of smaller-scale entities and it is decomposed into indicating matrix.The indicating matrix is used as the input of nonnegative matrix tri-factorization.Then,the manifold regularization is added on the basis of fast nonnegative matrix tri-factorization(FNMTF) to simultaneously cluster data inter-type relationships and intra-type relationships,improving the accuracy of clustering.Experiments show that the accuracy and performance of MNMTF algorithm are superior to the traditional co-clustering algorithms based on nonnegative matrix factorization.

Key words: Correlation matrix, Manifold regularization, Multi-type relational data, Nonnegative matrix factorization

CLC Number: 

  • TP391
[1]ROWEIS S T,SAUL L K.Nonlinear dimensionality reduction by locally linear embedding[J].Science,2000,290(5500):2323-2326.
[2]BELKIN M,NIYOGI P.Laplacian eigenmaps for dimensionality reduction and data representation [J].Neural Computation,2003,15(6):1373-1396.
[3]AILEM M,ROLE F,NADIF M.Co-clustering document-term matrices by direct maximization of graph modularity[C]∥ACM International on Conference on Information and Knowledge Management.New York:ACM Press,2015:1807-1810.
[4]HONDA K,TANAKA D,NOTSU A.Incremental algorithms for fuzzy co-clustering of very large cooccurrence matrix[C]∥IEEE International Conference on Fuzzy Systems.Piscataway:IEEE Press,2014:2494-2499.
[5]LEE D D,SEUNG H S.Learning the parts of objects with nonnegative matrix factorization[J].Nature,1999,401(21):788-791.
[6]LEE D D,SEUNG H S.Algorithms for non-negative matrix factorization[C]∥Neural Information Processing Systems.New York:NIPC Press 2000:535-541.
[7]DING C,HE X,SIMON H D,et al.On the equivalence of nonnegative matrix factorization and spectral clustering[C]∥SIAM International Conference on Data Mining.Philadelphia:SIAM Press,2005:606-610.
[8]DING C,LI T,PENG W,et al.Orthogonal nonnegative matrix tri-factorizations for clustering[C]∥ACM SIGKDD Internatio-nal Conference on Knowledge Discovery and Data Mining.New York:ACM Press,2006:126-135.
[9]LI Z,WU X.Weighted nonnegative matrix tri-factorization for co-clustering[C]∥IEEE International Conference on TOOLS with Artificial Intelligence.Piscataway:IEEE Press,2011:811-816.
[10]BUONO N D,PIO G.Non-negative Matrix Tri-Factorization for co-clustering:An analysis of the block matrix[J].Information Sciences,2015,301(20):13-26.
[11]GU Q,ZHOU J.Co-clustering on manifolds[C]∥ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York:ACM Press,2009:359-368.
[12]WANG S,HUANG A.Penalized nonnegative matrix tri-factorization for co-clustering[J].Expert Systems with Applications,2017,78(C):64-73.
[13]WANG S,GUO W.Robust co-clustering via dual local learning and high-order matrix factorization[J].Knowledge-Based Systems,2017,138(15):176-187.
[14]WANG H,NIE F,HUANG H,et al.Fast nonnegative matrix tri-factorization for large-scale data co-clustering[C]∥International Joint Conference on Artificial Intelligence.Menlo Park:AAAI Press,2011:1553-1558.
[15]SHEN G,YANG W,WANG W,et al.Large-scale heteroge-neous data co-clustering based on nonnegative matrix factorization[J].Journal of Computer Research and Development,2016,53(2):459-466.(in Chinese)
申国伟,杨武,王巍,等.基于非负矩阵分解的大规模异构数据联合聚类[J].计算机研究与发展,2016,53(2):459-466.
[1] YANG Lei, JIANG Ai-lian, QIANG Yan. Structure Preserving Unsupervised Feature Selection Based on Autoencoder and Manifold Regularization [J]. Computer Science, 2021, 48(8): 53-59.
[2] DUAN Fei, WANG Hui-min, ZHANG Chao. Cauchy Non-negative Matrix Factorization for Data Representation [J]. Computer Science, 2021, 48(6): 96-102.
[3] GAO Fang-yuan, WANG Xiu-mei. Subspace Clustering Method Based on Block Diagonal Representation and Neighbor Constraint [J]. Computer Science, 2020, 47(7): 66-70.
[4] LI Xiang-li, JIA Meng-xue. Nonnegative Matrix Factorization Algorithm with Hypergraph Based on Per-treatments [J]. Computer Science, 2020, 47(7): 71-77.
[5] WANG Li-xing, CAO Fu-yuan. Huber Loss Based Nonnegative Matrix Factorization Algorithm [J]. Computer Science, 2020, 47(11): 80-87.
[6] HE Xiao-wen, HU Yi-fei, WANG Hai-ping, CHEN Mo. Online Learning Nonnegative Matrix Factorization [J]. Computer Science, 2019, 46(6A): 473-477.
[7] JIA Xu, SUN Fu-ming, LI Hao-jie, CAO Yu-dong. Vein Recognition Algorithm Based on Supervised NMF with Two Regularization Terms [J]. Computer Science, 2018, 45(8): 283-287.
[8] YU Xiao, NIE Xiu-shan, MA Lin-yuan and YIN Yi-long. Robust Video Hashing Algorithm Based on Short-term Spatial Variations [J]. Computer Science, 2018, 45(2): 84-89.
[9] ZOU Li, CAI Xi-biao, SUN Jing, SUN Fu-ming. Hyperspectral Unmixing Algorithm Based on Dual Graph-regularized Semi-supervised NMF [J]. Computer Science, 2018, 45(12): 251-254.
[10] SUN Jing, CAI Xi-biao, JIANG Xiao-yan and SUN Fu-ming. Graph Regularized and Incremental Nonnegative Matrix Factorization with Sparseness Constraints [J]. Computer Science, 2017, 44(6): 298-305.
[11] TANG Bing, Laurent BOBELIN and HE Hai-wu. Parallel Algorithm of Nonnegative Matrix Factorization Based on Hybrid MPI and OpenMP Programming Model [J]. Computer Science, 2017, 44(3): 51-54.
[12] JIANG Xiao-yan, SUN Fu-ming and LI Hao-jie. Semi-supervised Nonnegative Matrix Factorization Based on Graph Regularization and Sparseness Constraints [J]. Computer Science, 2016, 43(7): 77-82.
[13] LIANG Qiu-xia, HE Guang-hui, CHEN Ru-li and CHU Jian-pu. Research of Face Recognition Algorithm Based on Nonnegative Tensor Factorization [J]. Computer Science, 2016, 43(10): 312-316.
[14] HU Xue-kao, SUN Fu-ming and LI Hao-jie. Constrained Nonnegative Matrix Factorization with Sparseness for Image Representation [J]. Computer Science, 2015, 42(7): 280-284.
[15] YANG Yao-fei and LI Ye-li. Magic Cards Recommendation Algorithm Based on Bayesian Theory [J]. Computer Science, 2014, 41(Z11): 72-74.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!