Computer Science ›› 2021, Vol. 48 ›› Issue (6): 86-95.doi: 10.11896/jsjkx.200800180

• Database & Big Data & Data Science • Previous Articles     Next Articles

Kernel Subspace Clustering Based on Second-order Neighbors

WANG Zhong-yuan, LIU Jing-lei   

  1. School of Computer and Control Engineering,Yantai University,Yantai,Shandong 264005,China
  • Received:2020-08-27 Revised:2020-09-18 Online:2021-06-15 Published:2021-06-03
  • About author:WANG Zhong-yuan,born in 1996,postgraduate.His main research interests include kernel approximation of low rank block matrix and so on.(79186799@qq.com)
    LIU Jing-lei,born in 1970,Ph.D,professor,master supervisor.His main research interests include artificial intelligent and theoretical computer science.
  • Supported by:
    National Natural Science Foundation of China (61572419,61773331,61703360,61801414).

Abstract: The processing of high-dimensional data sets is the focus of computer vision.Subspace clustering is one of the most widely used methods to achieve high-dimensional data clustering.The traditional subspace clustering assumes that the data comes from different linear subspaces,and different subspace regions do not overlap.However,real data often do not meet these two constraints,which affects the effect of subspace clustering.In order to deal with these two problems,this paper introduces a kernelized subspace to solve the nonlinear problem of subspace data,and introduces the second-order neighbors of the subspace coefficient matrix to deal with the overlapping subspace problem.Then a three-step clustering algorithm based on second-order neighbors of the kernelized subspace is designed.Firstly,the self-similarity coefficients of the kernelized subspace data are obtained.Secondly,the overlapping regions of the subspaces are eliminated.Finally,the coefficient matrix is spectrally clustered.In this paper,the designed subspace clustering algorithm is first tested on three artificial data sets,and then the experiment is performed on 12 real data sets,including face,scene characters and biomedical data sets.Experimental results show that the proposed algorithm has certain advantages over the latest algorithms.

Key words: Alternating direction multiplier method, Image identification, Kernel method, Second-order neighbors, Subspace clustering

CLC Number: 

  • TP18
[1]LIU Q S,LU H Q,MA S D.A review of subspace methods in face recognition Method[J].Acta Automatica Sinica,2003(6):900-911.
[2]DERKSEN H,YI M,WEI H.Segmentation of multivariatemixed data via lossy coding and compression[J].IEEE Tran-sactions on Pattern Analysis and Machine Intelligence,2007,29(9):1546-1562.
[3]ZHANG T,SZLAM A,LERMAN G.Median K-flats for hybrid linear modeling with many outliers [C]//IEEE 12th International Conference on Computer Vision Workshops.2009:234-241.
[4]HECKEL R,BOLCSKEI H.Robust Subspace Clustering viaThresholding [J].IEEE Transactions on Information Theory,2015,61(11):6320-6342.
[5]CAO W,ZHAO Y K,GAO S W.Multi-class support vector machine based on fuzzy kernel clustering[C]//Proceedings of 2009 China Process Systems Engineering Annual Conference and China Mes Annual Conference.2009:207-210.
[6]PENG X,YU Z,TANG H.Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering [J].IEEE Transactions on Cybernetics,2012,47(4):1053.
[7]DING Z C,GE H W,ZHOU J.Density peak clustering algorithm based on KL divergence[J].Journal of Chongqing University of Posts and Telecommunications(Natural Science Edition),2019,31(3):367-374.
[8]ZHOU H,REN H P.Intuitionistic fuzzy similarity clustering algorithm based on chi-square distance[J].Journal of Chongqing University of Technology(Natural Science),2020,34(8):238-246.
[9]AGRAWAL R,GEHRKE J,GUNOPULOS D.Automatic subspace clustering of high dimensional data for data mining applications [J].ACM SIGMOD Record,1998,27(2):94-105.
[10]LU C,FENG J,YAN S.A Unified Alternating Direction Me-thod of Multipliers by Majorization Minimization[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,40(3):527-541.
[11]VIDAL R,FAVARO P.Low rank subspace clustering(LRSC) [J].Pattern Recognition Letters,2014,43(1):47-61.
[12]ELHAMIFAR E,VIDAL R.Sparse Subspace Clustering:Algorithm,Theory,and Applications [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(11):2765-2781.
[13]ZHANG X,CHEN X,SUN X.Schatten-q regularizer constrainedlow rank subspace clustering model [J].Neurocomputing,2016,182(C):36-47.
[14]YOU C,LI C G,ROBINSON D P.Oracle Based Active Set Algorithm for Scalable Elastic Net Subspace Clustering [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016.3928-3937.
[15]LU C Y,MIN H,ZHAO Z Q.Robust and Efficient SubspaceSegmentation via Least Squares Regression [C]//Proceedings ofthe 12th European Conference on Computer Vision-Volume Part VII.2012:347-360.
[16]CHONG Y,LI C G,ROBINSON D P.Oracle Based Active Set Algorithm for Scalable Elastic Net Subspace Clustering [C]//2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2016:3928-3937.
[17]XU K J,RUAN J.Reweighted sparse subspace clustering [J].Computer Vision & Image Understanding,2015,138:25-37.
[18]ZHANG P T,CHEN X Y.Elastic nuclear subspace clustering[J].Pattern Recognition and Artificial Intelligence,2017,30(9):779-790.
[19]ZHANG Z,XU Y,SHAO L.Discriminative Block-DiagonalRepresentation Learning for Image Recognition[J].IEEE Transactions on Neural Networks & Learning Systems,2017,29(7):3111-3125.
[20]ABAVISANI M,PATEL V M.Multimodal sparse and low-rank subspace clustering [J].Information Fusion,2015,39:168-177.
[21]XIAO S,TAN M,XU D.Robust Kernel Low-Rank Representation [J].IEEE Transactions on Neural Networks & Learning Systems,2016,27(11):2268-2281.
[22]CHEN Y,JALALI A,SANGHAVI S.Clustering partially observed graphs via convex optimization [J].Journal of Machine Learning Research,2014,15(1):2213-2238.
[23]YANG J,LIANG J,WANG K.Subspace clustering via goodneighbors [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,42(6):1537-1544.
[24]CANDES E J,LI X,MA Y.Robust principal component analysis [J].Journal of the ACM,2011,58(3):11-48.
[25]LIU G,YAN S.Latent Low-Rank Representation for subspace segmentation and feature extraction [C]//InternationalConfe-rence on Computer Vision.2011:1615-1622.
[26]XIE X,GUO X,LIU G.Implicit Block Diagonal Low-Rank Representation [J].IEEE Transactions on Image Processing,2017,27(1):477-489.
[1] XU Jian-min, SUN Peng, WU Shu-fang. Microblog Rumor Detection Method Based on Propagation Path Tree Kernel Learning [J]. Computer Science, 2022, 49(6): 342-349.
[2] SHI Lin-shan, MA Chuang, YANG Yun, JIN Min. Anomaly Detection Algorithm Based on SSC-BP Neural Network [J]. Computer Science, 2021, 48(12): 357-363.
[3] GAO Fang-yuan, WANG Xiu-mei. Subspace Clustering Method Based on Block Diagonal Representation and Neighbor Constraint [J]. Computer Science, 2020, 47(7): 66-70.
[4] XING Yu-hua, LI Ming-xing. Robust Low Rank Subspace Clustering Algorithm Based on Projection [J]. Computer Science, 2020, 47(6): 92-97.
[5] LIU Shu-jun, WEI Lai. Block Integration Based Image Clustering Algorithm [J]. Computer Science, 2020, 47(6): 170-175.
[6] ZHU Ying-wen, YANG Jun. Euler Kernel-based Data Stream Clustering Algorithm [J]. Computer Science, 2019, 46(12): 74-82.
[7] HU Meng-qi, ZHENG Ji-ming. Blind Image Identification Algorithm Based on HSV Quantized Color Feature and SURF Detector [J]. Computer Science, 2019, 46(11A): 268-272.
[8] GONG Qu and XU Kai-qiang. Parameter-less Supervised Kernel Locality Preserving Projection and Face Recognition [J]. Computer Science, 2016, 43(9): 301-304.
[9] ZHENG Jian-wei, KONG Chen-chen, WANG Wan-liang, QIU Hong and ZHANG Hang-ke. Kernel-based Supervised Neighborhood Projection Analysis Algorithm [J]. Computer Science, 2016, 43(6): 312-315.
[10] ZHANG Heng-wei, HE Jia-jing, HAN Ji-hong and WANG Jin-dong. Fuzzy Soft Subspace Clustering Method Based on Intelligent Optimization Algorithm [J]. Computer Science, 2016, 43(3): 256-261.
[11] CHEN Li-ping and GUO Gong-de. Subspace Clustering Based on Sequential Feature [J]. Computer Science, 2016, 43(3): 72-74.
[12] XU Xue-yan,WANG Su-nan and WU Chun-ming. Network Traffic Classification Method Research Based on Subspace Clustering Algorithm [J]. Computer Science, 2014, 41(Z11): 301-306.
[13] WANG Li-juan,HAO Zhi-feng,CAI Rui-chu and WEN Wen. Multiple Local Adaptive Soft Subspace Clustering Ensemble Based on Multimodal Perturbation [J]. Computer Science, 2014, 41(2): 240-244.
[14] WANG Pei-yan and CAI Dong-feng. Distance-based Kernel Evaluation Measure [J]. Computer Science, 2014, 41(2): 72-75.
[15] . Face Feature Extraction Based on Weighted Multiple Kernel Fisher Discriminant Analysis [J]. Computer Science, 2012, 39(9): 262-265.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!