Computer Science ›› 2020, Vol. 47 ›› Issue (12): 119-124.doi: 10.11896/jsjkx.190900027

Previous Articles     Next Articles

Network Representation Learning Method on Fusing Node Structure and Content

ZHANG Hu, ZHOU Jing-jing, GAO Hai-hui, WANG Xin   

  1. School of Computer and Information Technology Shanxi University Taiyuan 030006,China
  • Received:2019-09-09 Revised:2020-04-03 Online:2020-12-15 Published:2020-12-17
  • About author:ZHANG Hu,born in 1979Ph.Dasso-ciate professoris a member of China Computer Federation.His main research interests include Natural Language Processing and representation learning.
  • Supported by:
    National Social Science Fund of China(18BYY074),National Natural Science Foundation of China (61936012,61806117) and Scientific and Technological Innovation Programs of Higher Education Institutions in Shanxi (201802012).

Abstract: With the rapid development of neural network Technology the network representation learning method for complex network has got more and more attention.It aims to learn the low-dimensional potential representation of nodes in the network and to apply the learned characteristic representation effectively to various analysis tasks for graph data.The typical shallow random walk network representation model is mainly based on two kinds of characteristic representation methodswhich are the node structure similarity and node content similarity.Howeverthe methods can't effectively capture similar information of node structure and content at the same timeand perform poorly on the network data with the equivalent structure and content.To this endthis paper explores the fusion characteristics of node structure and node contentand proposes a representation method called SN2vecwhich is based on joint learning of unsupervised shallow neural networks.Furtherin order to validate the effectiveness of the proposed modelthis paper respectively conduct the multi-label classification and down-dimensional visualization tasks in Brazilian air-trafficAmerican air-trafficand Wikipedia datasets.The results show that the Micro-F1 of using SN2vec in multi-label classification task is better than the existing shallow random walk network representation methodsand SN2vec can also learn better potential structural representation of consistent nodes.

Key words: Network representation learning, Random walk, Complex network, Shallow neural network

CLC Number: 

  • TP391
[1] GOYAL P,FERRARA E.Graph Embedding Techniques,Applications,and Performance:A Survey[J].Knowledge-Based Systems,2017,2(17):155-164.
[2] TANG L,LIU H.Leveraging social media networks for classification[J].Data Mining and Knowledge Discovery,2011,23(3):447-478.
[3] HAMILTON W L,YING R,LESKOVEC J.Representationlearning on graphs:Methods and applications[J].arXiv,2017:1709.05584.
[4] BENGIO Y,COURVILLE A,VINCENT P.Representationlearning:A review and new perspectives[J].IEEE TPAMI,2013,35(8):1798-1828.
[5] OU M D,CUI P,PEI J,et al.Asymmetric transitivity preserving graph embedding[C]//22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2016:1105-1114.
[6] PENNINGTON J,SORCHER R,MANNING C D.GloVe:Global vectors for word respresentation[C]//Conference on Empirical Methods in Natural Language Processing.2014.
[7] CAI H Y,ZHENG V W,CHANG K.A Comprehensive Survey of Graph Embedding:Problems,Techniques and Applications[J].arXiv:2017:1709.07604.
[8] WILLIAM L H,YING R,LESKOVEC J.Inductive Representation Learning on Large Graphs[J].arXiv:2017:1706.02216.
[9] BELKIN,MIKHAIL,PARTHA N.Laplacian eigenmaps andspectral techniques for embedding and clustering[J].Advances in Neural Information Processing Systems,2001,14(6):585-591.
[10] WOLD S,ESBENSEN K,GELADI P.Principal component ana-lysis[J].Chemometrics and Intelligent Laboratory Systems,1987,2(1/3):37-52.
[11] JOSEPH B,KRUSKAL,WISH M.Multidimensional scaling[M]//Methods,1978:116.
[12] TU C C,YANG C,LIU Z Y.A summary of network represents learning[J].Chinese Science:Information Science,2017,47(8):980-996.
[13] ZHOU J,CUI G Q,ZHANG Z Y,et al.Graph Neural Net-works:A Review of Methods and Applications[J].arXiv:1812.08434.
[14] WANG D X,CUI P,ZHU W W.Structural Deep Network Embedding[C]//The 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2016:1225-1234.
[15] YANG C,LIU Z Y ZHAO D L,et al.Network representation learning with rich text information[C]//International Joint Conference on Artificial Intelligence (IJCAI).2015:2111-2117.
[16] LI Q H,LI C P,ZHANG J,et al.Survey of Compressed Deep Neural Network[J].Computer Science,2019,46(9):1-14.
[17] MIKOLOV T,SUTSKEVER I,CHEN K,et al.DistributedRepresentations of Words and Phrases and their Compositionality[C]//Annual Conference on Neural Information Processing Systems (NIPS).2013:3111-3119.
[18] PEROZZI B,AL-RFOU R,SKIENA S.DeepWalk:OnlineLearning of Social Representations[C]//The 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD).2014:701-710.
[19] TANG T,QU M,WANG M,et al.LINE:Large-scale Information Network Embedding[C]//The 24th InternationalConfe-rence on World Wide Web (WWW).2015:1067-1077.
[20] GROVER A,LESKOVEC J.node2vec:Scalable Feature Learning for Networks[C]//22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2016:855-864.
[21] LEONARDO F,RIBEIRO R,PEDRO H P,et al.struc2vec:Learning Node Representations from Structural Identity[C]//The 23rd ACM SIGKDD International Conference on Know-ledge Discovery and Data Mining(KDD).2017:385-394.
[22] XU H,LIU H,WANG W,et al.NE-FLGC:Network Embed-ding Based on Fusing Local (First-Order) and Global (Second-Order) Network Structure with Node Content[C]//Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD).2018:260-271.
[23] CAO S H,LU W,XU Q K.GraRep:Learning Graph Representations with Global Structural Information[C]//The 24th ACM International Conference on Knowledge Discovery and Data Mining (KDD).2015:1105-1114.
[24] KAZEMI SEYED M,GOEL R,JAIN K,et al.Relational repre-sentation learning for dynamic (knowledge) graphs:a survey[J].arXiv:2019:1905.11485.
[25] Tsinghua University built on open source framework OpenNE[EB/OL].
[1] DING Yu, WEI Hao, PAN Zhi-song, LIU Xin. Survey of Network Representation Learning [J]. Computer Science, 2020, 47(9): 52-59.
[2] YANG Chao, LIU Zhi. Study on Complex Network Cascading Failure Based on Totally Asymmetric Simple Exclusion Process Model [J]. Computer Science, 2020, 47(9): 265-269.
[3] ZHANG Meng-yue, HU Jun, YAN Guan, LI Hui-jia. Analysis of China’s Patent Application Concern Based on Visibility Graph Network [J]. Computer Science, 2020, 47(8): 189-194.
[4] ZHANG Qing-qi, LIU Man-dan. Multi-objective Five-elements Cycle Optimization Algorithm for Complex Network Community Discovery [J]. Computer Science, 2020, 47(8): 284-290.
[5] LI Yang, LI Wei-gang, ZHAO Yun-tao, LIU Ao. Grey Wolf Algorithm Based on Levy Flight and Random Walk Strategy [J]. Computer Science, 2020, 47(8): 291-296.
[6] WANG Hui, LE Zi-chun, GONG Xuan, WU Yu-kun, ZUO Hao. Review of Link Prediction Methods Based on Feature Classification [J]. Computer Science, 2020, 47(8): 302-312.
[7] JIANG Zong-li, LI Miao-miao, ZHANG Jin-li. Graph Convolution of Fusion Meta-path Based Heterogeneous Network Representation Learning [J]. Computer Science, 2020, 47(7): 231-235.
[8] HUANG Yi, SHEN Guo-wei, ZHAO Wen-bo, GUO Chun. Network Representation Learning Algorithm Based on Vulnerability Threat Schema [J]. Computer Science, 2020, 47(7): 292-298.
[9] DONG Ming-gang, GONG Jia-ming and JING Chao. Multi-obJective Evolutionary Algorithm Based on Community Detection Spectral Clustering [J]. Computer Science, 2020, 47(6A): 461-466.
[10] YUAN Rong, SONG Yu-rong, MENG Fan-rong. Link Prediction Method Based on Weighted Network Topology Weight [J]. Computer Science, 2020, 47(5): 265-270.
[11] MA Yang, CHENG Guang-quan, LIANG Xing-xing, LI Yan, YANG Yu-ling, LIU Zhong. Improved SDNE in Weighted Directed Network [J]. Computer Science, 2020, 47(4): 233-237.
[12] RUAN Zi-rui,RUAN Zhong-yuan,SHEN Guo-jiang. Study of TASEP Model Based on Road Networks [J]. Computer Science, 2020, 47(1): 265-269.
[13] ZHAO Lei, ZHOU Jin-he. ICN Energy Efficiency Optimization Strategy Based on Content Field of Complex Networks [J]. Computer Science, 2019, 46(9): 137-142.
[14] CHEN Hang-yu, LI Hui-jia. Analysis of Characteristics and Applications of Chinese Aviation Complex Network Structure [J]. Computer Science, 2019, 46(6A): 300-304.
[15] LIU Xiao-dong, WEI Hai-ping, CAO Yu. Modeling and Stability Analysis for SIRS Model with Network Topology Changes [J]. Computer Science, 2019, 46(6A): 375-379.
Full text



[1] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[2] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99 .
[3] YANG Yu-qi, ZHANG Guo-an and JIN Xi-long. Dual-cluster-head Routing Protocol Based on Vehicle Density in VANETs[J]. Computer Science, 2018, 45(4): 126 -130 .
[4] ZHU Shu-qin, WANG Wen-hong and LI Jun-qing. Chosen Plaintext Attack on Chaotic Image Encryption Algorithm Based on Perceptron Model[J]. Computer Science, 2018, 45(4): 178 -181 .
[5] SUO Yan-feng, WANG Shao-jie, QIN Yu, LI Qiu-xiang, FENG Da-jun and LI Jing-chun. Summary of Security Technology and Application in Industrial Control System[J]. Computer Science, 2018, 45(4): 25 -33 .
[6] DENG Xia, CHANG Le, LIANG Jun-bin, JIANG Chan. Survey on Multicast Routing in Mobile Opportunistic Networks[J]. Computer Science, 2018, 45(6): 19 -26 .
[7] XIANG Ying-zhuo, TAN Ju-xian, HAN Jie-si, SHI Hao. Survey of Graph Matching Algorithms[J]. Computer Science, 2018, 45(6): 27 -31 .
[8] WANG Zhan-bing, SONG Wei, PENG Zhi-yong, YANG Xian-di, CUI Yi-hui, SHEN Yuan. Subsequence Outsourcing Query Method over Encrypted Genomic Data[J]. Computer Science, 2018, 45(6): 51 -56 .
[9] WU Wei-nan, LIU Jian-ming. Dynamic Retransmission Algorithm inLow-power Wireless Sensor Networks[J]. Computer Science, 2018, 45(6): 96 -99 .
[10] CHI Kai-kai, LIN Yi-min, LI Yan-jun, CHENG Zhen. Duty Cycle Scheme Maximizing Throughput in Energy Harvesting Sensor Networks[J]. Computer Science, 2018, 45(6): 100 -104 .