Computer Science ›› 2022, Vol. 49 ›› Issue (6A): 172-177.doi: 10.11896/jsjkx.210400117

• Intelligent Computing • Previous Articles     Next Articles

Automatic Generation of Patent Summarization Based on Graph Convolution Network

LI Jian-zhi, WANG Hong-ling, WANG Zhong-qing   

  1. School of Computer Science and Technology,Soochow University,Suzhou,Jiangsu 215006,China
  • Online:2022-06-10 Published:2022-06-08
  • About author:LI Jian-zhi,born in 1997,postgraduate,is a member of China Computer Federation.His main research interests include natural language processing and text summarization
    WANG Hong-ling,born in 1975,assistant professor,is a member of China Computer Federation.Her main research interests include natural language processing and information retrieval.
  • Supported by:
    National Natural Science Foundation of China(61976146) and Young Scientists Fund of the National Natural Science Foundation of China(61806137).

Abstract: The patent specification contains much useful information.However,due to the long space,it is difficult to obtain effective information quickly.Patent summarization is a summary of a complete patent specification.The right-claiming document determines the scope of protection of the patent application documents.It found that there is a special structure in the right-clai-ming document.Therefore,this paper proposes a method of automatic generation of patent summarization based on graph convolution network.The patent summarization is generated through the patent right-claiming document and its structural information.Firstly,this model obtains patent structural information,and the graph convolution neural network is introduced in the encoder to fuse the serialization information and structural information,to improve the quality of summarization.Experimental results show that this method has a significant improvement in ROUGE evaluation compared with the current main stream extractive summarization method and the traditional encoder-decoder abstractive summarization.

Key words: Automatic text summarization, Graph convolution network, Patent summarization, Right-claiming document

CLC Number: 

  • TP391
[1] ELAMn J L.Finding Structure in Time[J].Cognitive Science,1990,14(2):179-211.
[2] KIPF T N,WELLING M.Semi-Supervised Classification withGraph Convolutional Networks[J].arXiv:1609.02907,2016.
[3] HOCHREITER S,SCHMIDHUBERJ.Long Short-Term Me-mory[J].Neural Computation,1997,9(8):1735-1780.
[4] SHU Y F,WANG Z Q.Research on Chinese Patent Summariza-tion Based on Patented Structure[J].Computer Science,2020,47(S1):45-48.
[5] WANGY Z.Research on Abstract Generation Technology Based on Patent Text[D].Harbin:Harbin Institute of Technology,2020.
[6] ZHANG E B.Research on Key Technologies of GenerationPatent Claims[D].Harbin:Harbin Institute of Technology,2020.
[7] LIU T,WU Y,WANG K Z.Automatic Summarization[J].Information Science,1998(1):63-69.
[8] WANG H L,ZHOU G D,ZHU Q M.Chinese Multi-document Summarization Based on Redundancy Control[J].Journal of Chinese Information Processing,2012,26(2):92-96.
[9] PAGE L,BRIN S,MOTWANI R,et al.The PageRank CitationRanking:Bringing Order to the Web[C]//Proceedings of Technical Report.Stanford Digital Library Technologies,1998.
[10] MIHALCEA R,TARAUP.TextRank:Bringing Order into Texts[C]//Proceedings Conference on Empirical Methods in Natural Language Processing.2004.
[11] GÜNES Erkan,RADEV D R.LexPageRank:Prestige in multi-document text summarization[C]//Conference on Empirical Methods in Natural Language Processing.DBLP,2004.
[12] LIU F,FLANIGAN J,THOMSON S,et al.Toward Abstractive Summarization Using Semantic Representations[C]//Procee-dings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies,2015:1077-1086.
[13] RUSH A M,CHOPRA S,WESTON J.A neural attention model for abstractive sentence summarization[C]//Proceedings of the 2015 Conference Empirical Methods in Natural Language Processing.2015:379-389.
[14] CHOPRA S,AULI M,RUSHA M.Abstractive sentence summarization with attentive recurrent neural networks[C]//Proceedings of the 2016 Conference of the North American Chapter of Association for Computational Linguistics:Human Language Technologies.2016:93-98.
[15] NALLAPATI R,ZHOU B,DOS SANTOS C,et al.Abstractive text summarization using sequence-to-sequence RNNS and beyond[C]//Proceedings of the 20th SIGNLL Conference on Computational Natural Language Learning.2016:280-290.
[16] GU J,LU Z,LI H,et al.Incorporating Copying Mechanism in Sequence-to-Sequence Learning[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics.2016:1631-1640.
[17] SEE A,LIU P J,MANNING C D.Get To The Point:Summarization with Pointer-Generator Networks[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics.2017:1073-1083.
[18] GULCEHRE C,AHN S,NALLAPATIR,et al.Pointing the un-known words[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics.2016:140-149.
[19] ZENG W,LUO W,FIDLER S,et al.Efficient summarizationwith read-again and copy mechanism[J].arXiv:1611.03382,2016.
[20] COHAN A,DERNONCOURT F,KIM D S,et al.A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents[C]//Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.2018:615-621.
[21] WEI W,WANG H,WANG Z.Abstractive Summarization via Discourse Relation and Graph Convolutional Networks[M]//Natural Language Processing and Chinese Computing,9th CCF International Conference,NLPCC 2020.2020.
[22] WU R S,ZHANG Y F,WANG H L,et al.Abstractive Summarization Based on Hierarchical Structure[J]Journal of Chinese Information Processing,2019,33(10):90-98.
[23] ZHANG Y,WANG Z Q,WANG H L.Single Document Extractive Summarization with Satellite and Nuclear Relations[J].Journal of Chinese Information Processing,2019,33(10):90-98.
[24] VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[J].arXiv:1706.03762,2017.
[25] LIN C Y.Automatic evaluation of summaries[C]//Workshop on Text Summarization Branches Out at ACL.US,2010.
[26] KINGMA D,BA J.Adam:A Method for Stochastic Optimization[J].arXiv:1412.6980,2014.
[1] XIE Yu, YANG Rui-ling, LIU Gong-xu, LI De-yu, WANG Wen-jian. Human Skeleton Action Recognition Algorithm Based on Dynamic Topological Graph [J]. Computer Science, 2022, 49(2): 62-68.
[2] CHENG Si-wei, GE Wei-yi, WANG Yu, XU Jian. BGCN:Trigger Detection Based on BERT and Graph Convolution Network [J]. Computer Science, 2021, 48(7): 292-298.
[3] WANG Wen-bo, LUO Heng-li. Complete Graph Face Clustering Based on Graph Convolution Network [J]. Computer Science, 2021, 48(11A): 275-277.
[4] WANG Jun-li, WEI Shao-chen and GUAN Min. Survey on Graph Model-based Document Summarization [J]. Computer Science, 2015, 42(12): 1-7.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!