Computer Science ›› 2024, Vol. 51 ›› Issue (4): 95-105.doi: 10.11896/jsjkx.230600071

• Database & Big Data & Data Science • Previous Articles     Next Articles

Review of Node Classification Methods Based on Graph Convolutional Neural Networks

ZHANG Liying1, SUN Haihang1, SUN Yufa2 , SHI Bingbo3   

  1. 1 College of Information Science and Engineering,China University of Petroleum(Beijing),Beijing 102249,China
    2 Petroleum Industry Press,Beijing 100011,China
    3 Research Institute of Petroleum Exploration & Development,Beijing 100083,China
  • Received:2023-06-08 Revised:2023-09-13 Online:2024-04-15 Published:2024-04-10

Abstract: Node classification is one of the important research tasks in graph field.In recent years,with the continuous deepening of research on graph convolutional neural network,significant progress has been made in the research and application of node classification based on graph convolutional neural networks.Graph convolutional neural networks are kind of graph neural network method based on convolution.It can handle graph data and have the advantages of convolutional neural networks,and have become the most active branch of graph node classification research.This paper first introduces the related concepts of graph,the definition of node classification and commonly used graph datasets.Then,it reviews two classic graph convolutional neural networks,spectral domain and spatial domain graph convolutional neural networks,and discusses the challenges of using graph con-volutional neural networks to study node classification.Next,it analyzes the research progress and unresolved issues of graph convolutional neural networks in node classification tasks from the perspectives of model and data.Finally,this paper gives insights into the research direction on node classification based on graph convolutional neural networks.

Key words: Graph structure data, Node classification, Graph neural network, Graph convolutional neural network

CLC Number: 

  • TP391
[1]KIPF T N,WELLING M.Semi-supervised classification withgraph convolutional networks[J].arXiv:1609.02907,2016.
[2]SEN P,NAMATA G,BILGIC M,et al.Collective Classification in Network Data[J].AI Magazine,2008,29(3):93.
[3]LU Z,KIM W,WILBUR W J.Evaluating relevance rankingstrategies for MEDLINE retrieval.[J].Journal of the American Medical Informatics Association,2009,16(1):32-36.
[4]Social Network:Reddit Hyperlink Network[EB/OL].http://snap.stanford.edu/data/soc-RedditHyperlinks.html.
[5]GROVER A,LESKOVEC J.node2vec:Scalable feature learning for networks[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mi-ning.2016:855-864.
[6]HU W,FEY M,ZITNIK M,et al.Open graph benchmark:Datasets for machine learning on graphs[J].Advances in Neural Information Processing Systems,2020,33:22118-22133.
[7]XIE Y Y,FENG X,YU W J,et al.Network Embedding Method based on Randomized Matrix Factorization [J].Journal of Computer Research and Development,2021,44(3):447-461.
[8]HAMILTON W L,YING R,LESKOVEC J.Inductive representation learning on large graphs[C]//Proc.of the Conf.on Neural Information Processing Systems(NIPS).Cambridge:MIT Press,2017:1024-1034.
[9]BRUNA J,ZAREMBA W,SZLAM A,et al.Spectral networks and locally connected networks on graphs[J].arXiv.1312.6203,2013.
[10]HENAFF M,BRUNA J,LECUN Y.Deep Convolutional Net-works on Graph-Structured Data[J].arXiv.1506.05163,2015.
[11]DUVENAUD D,MACLAURIN D,AGUILERA-IPARRAGUIRRE J,et al.Convolutional networks on graphs for learning molecular fingerprints[J].arXiv:1509.09292,2015.
[12]WU F,SOUZA A,ZHANG T,et al.Simplifying graph convolutional networks[C]//International Conference on Machine Learning.PMLR,2019:6861-6871.
[13]XU K,LI C,TIAN Y,et al.Representation learning on graphs with jumping knowledge networks[C]//International Confe-rence on Machine Learning.PMLR,2018:5453-5462.
[14]ABU-EL-HAIJA S,PEROZZI B,KAPOOR A,et al.MixHop:higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing[C]//International Conferencce on Machine Learning.PMLR,2019:21-29.
[15]MICHELI A.Neural network for graphs:a contextual constructive approach[J].IEEE Transactions on Neural Networks,2009,20(3):498-511.
[16]GILMER J,SCHOENHOLZ S S,RILEY P F,et al.Neural message passing for quantum chemistry[C]//International Confe-rence on Machine Learning.PMLR,2017:1263-1272.
[17]HECHTLINGER Y,CHAKRAVARTI P,QIN J.A generalization of convolutional neural networks to graph-structured data[J].arXiv:1704.08165,2017.
[18]VELIČKOVIĆ P,CUCURULL G,CASANOVA A,et al.Graph attention networks[J].arXiv:1710.10903,2017.
[19]HUANG W,ZHANG T,RONG Y,et al.Adaptive sampling towards fast graph representation learning[J].arXiv.1809.05343,2018.
[20]CHIANG W L,LIU X,SI S,et al.Cluster-GCN:An efficient algorithm for training deep and large graph convolutional networks[J].arXiv.1905.07953,2019.
[21]CHEN J,MA T,XIAO C.FastGCN:Fast Learning with Graph Convolutional Networks via Importance Sampling[J].arXiv.1801.10247,2018.
[22]CHEN H,HUANG Z,XU Y,et al.Neighbor enhanced graph convolutional networks for node classification and recommendation[J].arXiv.2203.16097,2022.
[23]YING R,YOU J,MORRIS C,et al.Hierarchical graph representation learning with differentiable pooling[C]//Proceedings of the Annual Conference on Neural Information Processing Systems.Cambridge,MA:MITPress,2018:4805-4815.
[24]TITOV I,WELLING M,SCHLICHTKRULL M,et al.Mode-ling relational data with graph convolutional networks[C]//Proceedings of the 15th European Semantic Web Conference.2018:593-607.
[25]ZHANG H Q.Research on Several Node Classification Methods based on Graph Learning [D].Guilin:Guangxi Normal University,2022.
[26]SHI S,QIAO K,YANG S,et al.Boosting-GNN:boosting algorithm for graph networks on imbalanced node classification[J].Frontiers in Neurorobotics,2021,15:775688.
[27]LI G,MÜLLER M,THABET A,et al.DeepGCNs:Can GCNsGo As Deep As CNNs?[C]//2019 IEEE/CVF International Conference on Computer Vision(ICCV).IEEE,2020.
[28]SUN K,ZHU Z,LIN Z.Adagcn:Adaboosting graph convolutional networks into deep models[J].arXiv:1908.05081,2019.
[29]ABU-EL-HAIJA S,KAPOOR A,PEROZZI B,et al.N-gcn:Multi-scale graph convolution for semi-supervised node classification[C]//Uncertainty in Artificial Intelligence.PMLR,2020:841-851.
[30]HUANG G,LIU Z,LAURENS V D M,et al.Densely Connec-ted Convolutional Networks[C]//CVPR 2017.IEEE Computer Society,2016.
[31]SZEGEDY C,LIU W,JIA Y,et al.Going Deeper with Convolutions[C]//CVPR 2014.IEEE Computer Society,2014.
[32]YU B,YIN H,ZHU Z.Spatio-Temporal Graph Convolutional Networks:A Deep Learning Framework for Traffic Forecasting[C]//IJCAI 2017.2017.
[33]PAREJA A,DOMENICONI G,CHEN J,et al.Evolvegcn:Evolving graph convolutional networks for dynamic graphs[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:5363-5370.
[34]SANKAR A,WU Y,GOU L,et al.DySAT:Deep Neural Representation Learning on Dynamic Graphs via Self-Attention Networks[C]//The Thirteenth ACM International Conference on Web Search and Data Mining(WSDM'20).ACM,2020.
[35]XU D,RUAN C W,KORPEOGLU E,et al.Inductive representation learning on temporal graphs[J].arXiv:2002.07962,2020.
[36]MA Y,GUO Z,REN Z,et al.Streaming Graph Neural Net-works[C]//The 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR'20).ACM,2020.
[37]LIU Z,SHEN Y,CHENG X,et al.Learning representations of inactive users:A cross domain approach with graph neural networks[C]//Proceedings of the 30th ACM International Confe-rence on Information & Knowledge Management.2021:3278-3282.
[38]ZHANG L,WU N.HGCC:Enhancing Hyperbolic Graph Convolution Networks on Heterogeneous Collaborative Graph for Recommendation[J].arXiv:2304.02961,2023.
[39]ZENG H,ZHOU H,SRIVASTAVA A,et al.Graphsaint:Graph sampling based inductive learning method[J].arXiv:1907.04931,2019.
[40]WANG S,PAN Y,ZHANG J,et al.Robust and label efficient bi-filtering graph convolutional networks for node classification[J].Knowledge-Based Systems,2021,224:106891.
[41]HUANG J,DU L,CHEN X,et al.Robust Mid-Pass Filtering Graph Convolutional Networks[J].arXiv:2302.08048,2023.
[42]DING M,TANG J,ZHANG J.Semi-supervised learning ongraphs with generative adversarial nets[C]//Proceedings of the 27th ACM International Conference on Information and Know-ledge Management.2018:913-922.
[43]ZHU D,ZHANG Z,CUI P,et al.Robust Graph Convolutional Networks Against Adversarial Attacks[C]//The 25th ACM SIGKDD International Conference.ACM,2019.
[44]HOANG N T,MAEHARA T.Revisiting graph neural networks:All we have is low-pass filters[J].arXiv:1905.09550,2019.
[45]MONGWE W T,MALAN K M.A survey of automated financial statement fraud detection with relevance to the South African context[J].South African Computer Journal,2020(1):74-112.
[46]LARRAZABAL A J,NIETO N,PETERSON V,et al.Gender imbalance in medical imaging datasets produces biased classifiers for computer-aided diagnosis[J].Proceedings of the National Academy of Sciences,2020,117(23):201919012.
[47]YU S A,YW A,XIN Y A,et al.Multi-view ensemble learning based on distance-to-model and adaptive clustering for imba-lanced credit risk assessment in P2P lending[J].Information Sciences,2020,525:182-204.
[48]ZHAO T,ZHANG X,WANG S.GraphSMOTE:ImbalancedNode Classification on Graphs with Graph Neural Networks[C]//WSDM'21.ACM,2021.
[49]WU L,LIN H,GAO Z,et al.Graphmixup:Improving class-imbalanced node classification on graphs by self-supervised context prediction[J].arXiv:2106.11133,2021.
[50]QU L,ZHU H,ZHENG R,et al.ImGAGN:Imbalanced Net-work Embedding via Generative Adversarial Graph Networks[J].arXiv:2106.02817,2021.
[51]JOONHYUNG P,JAEYUN S.GraphENS:Neighbor-aware ego network synthesis for class-imbalanced node classification[C]//The 9th International Conference on Learning Representations.Virtual:OpenReview.net,2021.
[52]SHI M,TANG Y,ZHU X,et al.Multi-Class Imbalanced Graph Convolutional Network Learning[C]//International Joint Conference on Artificial Intelligence.International Joint Conferences on Artificial Intelligence Organization,2020.
[53]HUANG Z,TANG Y,CHEN Y.A graph neural network-based node classification model on class-imbalanced graph data[J].Knowledge-Based Systems,2022,244(23):108538.1-108538.12.
[54]WANG Y,AGGARWAL C,DERR T.Distance-wise prototypical graph neural network in node imbalance classification[J].arXiv:2110.12035,2021.
[55]LI X,WEN L,DENG Y,et al.Graph neural network with curriculum learning for imbalanced node classification[J].arXiv:2202.02529,2022.
[56]CHAWLA N V,BOWYER K W,HALL L O,et al.SMOTE:Synthetic Minority Over-sampling Technique[J].Journal of Artificial Intelligence Research,2002,16(1):321-357.
[57]MORE A.Survey of resampling techniques for improving classification performance in unbalanced datasets[J].arXiv.1608.06048,2016.
[58]THAI-NGHE N,GANTNER Z,SCHMIDT-THIEME L,et al.Cost-sensitive learning methods for imbalanced data[C]//International Joint Conference on Neural Networks.IEEE,2010.
[1] ZHANG Tao, LIAO Bin, YU Jiong, LI Ming, SUN Ruina. Benchmarking and Analysis for Graph Neural Network Node Classification Task [J]. Computer Science, 2024, 51(4): 132-150.
[2] YAN Wenjie, YIN Yiying. Human Action Recognition Algorithm Based on Adaptive Shifted Graph Convolutional Neural
Network with 3D Skeleton Similarity
[J]. Computer Science, 2024, 51(4): 236-242.
[3] LUO Zeyang, TIAN Hua, DOU Yingtong, LI Manwen, ZHANG Zehua. Fake Review Detection Based on Residual Networks Fusion of Multi-relationship Review Features [J]. Computer Science, 2024, 51(4): 314-323.
[4] CHEN Yufeng , HUANG Zengfeng. Framework and Algorithms for Accelerating Training of Semi-supervised Graph Neural Network Based on Heuristic Coarsening Algorithms [J]. Computer Science, 2024, 51(3): 48-55.
[5] HUANG Kun, SUN Weiwei. Traffic Speed Forecasting Algorithm Based on Missing Data [J]. Computer Science, 2024, 51(3): 72-80.
[6] CHEN Wei, ZHOU Lihua, WANG Yafeng, WANG Lizhen, CHEN Hongmei. Community Search Based on Disentangled Graph Neural Network in Heterogeneous Information Networks [J]. Computer Science, 2024, 51(3): 90-101.
[7] ZHANG Guohao, WANG Yi, ZHOU Xi, WANG Baoquan. Deep Collaborative Truth Discovery Based on Variational Multi-hop Graph Attention Encoder [J]. Computer Science, 2024, 51(3): 109-117.
[8] ZHENG Cheng, SHI Jingwei, WEI Suhua, CHENG Jiaming. Dual Feature Adaptive Fusion Network Based on Dependency Type Pruning for Aspect-basedSentiment Analysis [J]. Computer Science, 2024, 51(3): 205-213.
[9] XU Tianyue, LIU Xianhui, ZHAO Weidong. Knowledge Graph and User Interest Based Recommendation Algorithm [J]. Computer Science, 2024, 51(2): 55-62.
[10] JIN Yu, CHEN Hongmei, LUO Chuan. Interest Capturing Recommendation Based on Knowledge Graph [J]. Computer Science, 2024, 51(1): 133-142.
[11] WU Jiawei, FANG Quan, HU Jun, QIAN Shengsheng. Pre-training of Heterogeneous Graph Neural Networks for Multi-label Document Classification [J]. Computer Science, 2024, 51(1): 143-149.
[12] GUO Yuxing, YAO Kaixuan, WANG Zhiqiang, WEN Liangliang, LIANG Jiye. Black-box Graph Adversarial Attacks Based on Topology and Feature Fusion [J]. Computer Science, 2024, 51(1): 355-362.
[13] YI Qiuhua, GAO Haoran, CHEN Xinqi, KONG Xiangjie. Human Mobility Pattern Prior Knowledge Based POI Recommendation [J]. Computer Science, 2023, 50(9): 139-144.
[14] JIANG Linpu, CHEN Kejia. Self-supervised Dynamic Graph Representation Learning Approach Based on Contrastive Prediction [J]. Computer Science, 2023, 50(7): 207-212.
[15] LI Rongchang, ZHENG Haibin, ZHAO Wenhong, CHEN Jinyin. Data Reconstruction Attack for Vertical Graph Federated Learning [J]. Computer Science, 2023, 50(7): 332-338.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!