Computer Science ›› 2022, Vol. 49 ›› Issue (6A): 150-158.doi: 10.11896/jsjkx.210500065

• Intelligent Computing • Previous Articles     Next Articles

Deep Integrated Learning Software Requirement Classification Fusing Bert and Graph Convolution

KANG Yan, WU Zhi-wei, KOU Yong-qi, ZHANG Lan, XIE Si-yu, LI Hao   

  1. College of Software,Yunnan University,Kunming 650091,China
  • Online:2022-06-10 Published:2022-06-08
  • About author:KANG Yan,born in 1972,Ph.D,asso-ciate professor.Her main research inte-rests includetransfer learning,deep learning and integrated learning.
    LI Hao,born in 1970,Ph.D,professor.His main research interests include distributed computing,grid and cloud computing.
  • Supported by:
    National Natural Science Foundation of China(61762092),Major Project of Yunnan Provincial Science and Technology Department(2019ZE001-1,202002AB080001-6) and Open Foundation of Yunnan Key Laboratory of Software Engineering(2020SE303).

Abstract: With the rapid growth of software quantity and types,effectively mine the textual features of software requirements and classify the textual features of software functional requirements becomes a major challenge in the field of software enginee-ring.The classification of software functional requirements provides a reliable guarantee for the whole software development process and reduces the potential risks and negative effects in the requirements analysis stage.However,the validity of software requirement analysis is limited by the high dispersion,high noise and sparse data of software requirement text.In this paper,a two-layer lexical graph convolutional network model(TVGCCN) is proposed to model the graph of software requirement text innovatively,build the graph neural network of software requirement,and effectively capture the knowledge edge of words and the relationship between words and text.A deep integrated learning model is proposed,which integrates several deep learning classification models to classify software requirement text.In experiments of data set Wiodows_A and data Wiodows_B,the accuracy of deep ensemble learning model integrating Bert and graph convolution reaches 96.73% and 95.60% respectively,which is ob-viously better than that of other text classification models.It is fully proved that the deep ensemble learning model integrating Bert and graph convolution can effectively distinguish the functional characteristics of software requirement text and improve the accuracy of software requirement text classification.

Key words: BERT, Ensemble learning, GCN, Software requirements, Text classification, Text features

CLC Number: 

  • TP181
[1] ERNST N A,MYLOPOULOS J.On the perception of software quality requirements during the project lifecycle[C]//16th International Working Conference(REFSQ 2010).Springer Berlin Heidelberg,2010:143-157.
[2] NIU NEASTERBROOK S.Extracting and modeling productline functional requirements[C]//16th IEEE International Requirements Engineering Conference.2008:155-164.
[3] KNAUSS E,DAMIAN D,POO-CAAMANO G,et al.Detecting and classifying patterns of requirements clarifications[J].IEEE Computer Society,2012:251-260.
[4] KO Y,PARK S,SEO J,et al.Using classification techniques for informal requirements in the requirements analysis-supporting system[J].Information & Software Technology,2007,49(11/12):1128-1140.
[5] RAHIMI N,EASSA F,ELREFAEI L.An Ensemble Machine Learning Technique for Functional Requirement Classification[J].Symmetry,2020,12(10):1601.
[6] HU W S,YANG J F,ZHAO M.Demand analysis based on greyclustering algorithm[J].Computer Science,2016,43(S1):471-475.
[7] MARTIN J,KLEINROCK L.Excerpts from:An InformationSystems Manifesto[J].Communications of the ACM,1985,28(3):252-255.
[8] ABAD Z,KARRAS O,GHAZI P,et al.What Works Better? A Study of Classifying Requirements[C]//2017 IEEE 25th International Requirements Engineering Conference.IEEE,2017:496-501.
[9] TIUN S,MOKHTAR U A,BAKAR S H,et al.Classification of functional and non-functional requirement in software requirement using Word2vec and fast Text[J].Journal of Physics:Conference Series,2020,1529(4):042077.
[10] KIM Y.Convolutional Neural Networks for Sentence Classification[J].arXiv:1408.5882,2014.
[11] YAO L,MAO C,LUO Y.Graph Convolutional Networks for Text Classification[J].Proceedings of the AAAI Conference on Artificial Intelligence,2019,33(1):7370-7377.
[12] DEVLIN J,CHANG M W,LEE K,et al.BERT:Pre-training of Deep Bidirectional Transformers for Language Understanding[J].arXiv:1810.04805,2018.
[13] KIP F N,WELLING M.Semi-Supervised Classification withGraph Convolutional Networks[J].arXiv:1609.02907,2016.
[14] JEONG C,JANG S,SHIN H,et al.A Context-Aware Citation Recommendation Model with BERT and Graph Convolutional Networks[J].arXiv:1903.06464,2019.
[15] RASCHKA S.Ensemble Vote Classifier-mlxtend[EB/OL].http://rasbt.github.io/mlxtend/user_guide/classifier/EnsembleVoteClassifier/.
[16] GIRSHICK R,DONAHUE J,DARRELL T,et al.Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation[J].arXiv:1311.2524,2013.
[17] JOHNSON R,TONG Z.Deep Pyramid Convolutional NeuralNetworks for Text Categorization[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics.2017.
[18] WARSTADT A,SINGH A,BOWMAN S R.Neural network acceptability judgments[J].arXiv:1805.12471,2018.
[19] SOCHER R,PERELYGIN A,WU J,et al.Recursive deep mo-dels for semantic compositionality over a sentiment treebank[C]//Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing(EMNLP).2013:1631-1642.
[20] KANG Y,CUI G R,LI H,et al.Software Requirements Clustering Algorithm Based on Self-attention Mechanism and Multi-channel Pyramid Convolution[J].Computer Science,2020,47(3):48-53.
[21] YAO L,MAO C,LUO Y.Graph convolutional networks fortext classification[J].Proceedings of the AAAI Conference on Artificial Intelligence,2019,33(1):7370-7377.
[22] LU Z,DU P,NIE J Y.VGCN-BERT:augmenting BERT with graph embedding for text classification[C]//European Confe-rence on Information Retrieval.Cham:Springer,2020:369-382.
[23] HOCHREITER,SEPP,SCHMIDHUBER,et al.Long short-term memory[J].Neural Computation,1997,9(8):1735-1780.
[24] DEVLIN J,CHANG M W,LEE K,et al.:Bert Pre-training of deep bidirectional transformers for language understanding[J].arXiv:1810.04805,2018.
[25] LEVER J,KRZYWINSKI M,ALTMAN N.Classification evaluation[J].Nature Methods,2016,13(8):603-604.
[1] WU Hong-xin, HAN Meng, CHEN Zhi-qiang, ZHANG Xi-long, LI Mu-hang. Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning [J]. Computer Science, 2022, 49(8): 12-25.
[2] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[3] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[4] TAN Ying-ying, WANG Jun-li, ZHANG Chao-bo. Review of Text Classification Methods Based on Graph Convolutional Network [J]. Computer Science, 2022, 49(8): 205-216.
[5] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[6] SHAO Xin-xin. TI-FastText Automatic Goods Classification Algorithm [J]. Computer Science, 2022, 49(6A): 206-210.
[7] YU Jia-qi, KANG Xiao-dong, BAI Cheng-cheng, LIU Han-qing. New Text Retrieval Model of Chinese Electronic Medical Records [J]. Computer Science, 2022, 49(6A): 32-38.
[8] DENG Kai, YANG Pin, LI Yi-zhou, YANG Xing, ZENG Fan-rui, ZHANG Zhen-yu. Fast and Transmissible Domain Knowledge Graph Construction Method [J]. Computer Science, 2022, 49(6A): 100-108.
[9] LIN Xi, CHEN Zi-zhuo, WANG Zhong-qing. Aspect-level Sentiment Classification Based on Imbalanced Data and Ensemble Learning [J]. Computer Science, 2022, 49(6A): 144-149.
[10] YU Ben-gong, ZHANG Zi-wei, WANG Hui-ling. TS-AC-EWM Online Product Ranking Method Based on Multi-level Emotion and Topic Information [J]. Computer Science, 2022, 49(6A): 165-171.
[11] WANG Yu-fei, CHEN Wen. Tri-training Algorithm Based on DECORATE Ensemble Learning and Credibility Assessment [J]. Computer Science, 2022, 49(6): 127-133.
[12] GUO Yu-xin, CHEN Xiu-hong. Automatic Summarization Model Combining BERT Word Embedding Representation and Topic Information Enhancement [J]. Computer Science, 2022, 49(6): 313-318.
[13] DENG Zhao-yang, ZHONG Guo-qiang, WANG Dong. Text Classification Based on Attention Gated Graph Neural Network [J]. Computer Science, 2022, 49(6): 326-334.
[14] HAN Hong-qi, RAN Ya-xin, ZHANG Yun-liang, GUI Jie, GAO Xiong, YI Meng-lin. Study on Cross-media Information Retrieval Based on Common Subspace Classification Learning [J]. Computer Science, 2022, 49(5): 33-42.
[15] LIU Shuo, WANG Geng-run, PENG Jian-hua, LI Ke. Chinese Short Text Classification Algorithm Based on Hybrid Features of Characters and Words [J]. Computer Science, 2022, 49(4): 282-287.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!