Computer Science ›› 2025, Vol. 52 ›› Issue (6): 330-335.doi: 10.11896/jsjkx.240400043

• Artificial Intelligence • Previous Articles     Next Articles

Study on Text Component Recognition of Narrative Texts Based on Prompt Learning

WANG Xiaoyi1, WANG Jiong2, LIU Jie1,3, ZHOU Jianshe1   

  1. 1 China Language Intelligence Research Center,Capital Normal University,Beijing 100048,China
    2 School of Information Engineering,Capital Normal University,Beijing 100048,China
    3 School of Information Technology,North China University of Technology,Beijing 100144,China
  • Received:2024-04-07 Revised:2024-09-12 Online:2025-06-15 Published:2025-06-11
  • About author:WANG Xiaoyi,born in 1997,Ph.D.Her main research interests include natural language processing and automated essay scoring.
    LIU Jie,born in 1970,Ph.D,professor,Ph.D supervisor,is a member of CCF(No.10359S).His main research in-terests include natural language processing and knowledge engineering.
  • Supported by:
    National Key Research and Development Program of China(2020AAA0109703) and National Natural Science Foundation of China(62076167,U23B2029).

Abstract: Text structure analysis is one of the important techniques in automated essay scoring and an important research topic in the field of natural language processing.In recent years,research on the analysis of essay structure has been scarce and mainly focused on argumentative essays.There are still shortcomings in the study of narrative texts,especially in terms of research me-thods and resources,which are relatively limited.In response to these issues,this paper constructs a corpus for identifying the components of narrative texts in primary and secondary schools.A corpus automatic annotation model based on BERT-BiLSTM is used to improve annotation efficiency,and statistical analysis is conducted on content distribution and consistency of corpus annotation.This paper proposes a narrative text component recognition method based on prompt learning,which automatically constructs prefix prompt templates for recognizing text components and utilizes hierarchical attention mechanism to learn richer text features,thereby improving the ability to recognize narrative text structure.Experiments are conducted on a self-built dataset,and the results show that the proposed method improves the accuracy of narrative discourse structure to 85.80%,which is superior to the pre-trained language models used for comparison.

Key words: Dataset construction, Text structure, Automated essay scoring, Prompt learning

CLC Number: 

  • TP391
[1]BURSTEIN J,MARCU D,KNIGHT K.Finding the WRITEStuff:Automatic Identification of Discourse Structure in Student Essays[J].IEEE Intelligent Systems,2003,18(1):32-39.
[2]STAB C,GUREVYCH I.Parsing Argumentation Structures in Persuasive Essays[J].Computational Linguistics,2017,43(3):619-659.
[3]WANG Q.A review of narrative writing for high school en-trance examination based on“scoring criteria” [J].Bulletin Chinese Language Teaching,2016,(32):71-72.
[4]XU F,ZHU Q M,ZHOU G D.Survey of Discourse Analysis Methods[J].Journal of Chinese Information Processing,2013,27(3):20-33.
[5]HU W C,YANG Y L,WU C X.Survey of Implicit Discourse Relation Recognition Based on Deep Learning[J].Computer Science,2020,47(4):157-163.
[6]KENTON J D M W C,TOUTANOVA L K.BERT:Pre-training of Deep Bidirectional Transformers for Language Understanding[C]//Proceedings of NAACL-HLT.2019:4171-4186.
[7]RADFORD A,WU J,CHILD R,et al.Language models are un-supervised multitask learners[J].OpenAI blog,2019,1(8):9.
[8]SCHICK T,SCHÜTZE H.Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference[C]//Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics.2021:255-269.
[9]PRENDINGER H.A novel discourse parser based on supportvector machine classification[C]//Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP.2009:665-673.
[10]SONG W,FU R,LIU L,et al.Discourse element identification in student essays based on global and local cohesion[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.2015:2255-2261.
[11]KONG F,ZHOU G.A CDT-styled end-to-end Chinese discourse parser[J].ACM Transactions on Asian and Low-Resource Language Information Processing,2017,16(4):1-17.
[12]XU S,LI P,ZHOU G,et al.Employing text matching network to recognise nuclearity in chinese discourse[C]//Proceedings of the 27th International Conference on Computational Linguistics.2018:525-535.
[13]ZHOU M,JIA Y M,ZHOU C L,et al.An automatic grading method for English compositions based on discourse structure [J].Computer Science,2019,46(3):234-241.
[14]WANG X Y,WANG J C,LIU J.Evaluation of Chinese Narrative Text Structure Based on Fusion of Text Component Recognition [J].Small Micro Computer System,2025,46(1):55-63.
[15]CHEN Y,ZHANG S,QI G,et al.Parameterizing context:Unleashing the power of parameter-efficient fine-tuning and incontext tuning for continual table semantic parsing[C]//NeurIPS 2023.2023.
[16]WU J,YU T,WANG R,et al.Infoprompt:Information-theore-tic soft prompt tuning for natural language understanding[J].arXiv:2306.04933,2023.
[17]CHO Y J,LIU L,XU Z,et al.Heterogeneous lora for federated fine-tuning of on-device foundation models[C]//International Workshop on Federated Learning in the Age of Foundation Models in Conjunction with NeurIPS 2023.2023.
[18]LIALIN V,DESHPANDE V,RUMSHISKY A.Scaling down to scale up:A guide to parameter-efficient fine-tuning[J].arXiv:2303.15647,2023.
[19]JOULIN A,GRAVE É,BOJANOWSKI P,et al.Bag of Tricks for Efficient Text Classification[C]//Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics.2017:427-431.
[20]CHEN Y.Convolutional neural network for sentence classification[D].Waterloo:University of Waterloo,2015.
[21]LI X L,LIANG P.Prefix-Tuning:Optimizing Continuous Pro-mptsfor Generation[C]//Proceedings of the 59th Annual Mee-ting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.2021:4582-4597.
[22]CHEN N,LI X H.An Event Extraction Method Based on Template Prompt Learning[J].Data Analysis and Knowledge Discovery,2023,7(6):86-98.
[1] LI Bo, MO Xian. Application of Large Language Models in Recommendation System [J]. Computer Science, 2025, 52(6A): 240400097-7.
[2] LI Jiawei , DENG Yuandan, CHEN Bo. Domain UML Model Automatic Construction Based on Fine-tuning Qwen2 [J]. Computer Science, 2025, 52(6A): 240900155-4.
[3] WANG Tianyi, LIN Youfang, GONG Letian, CHEN Wei, GUO Shengnan, WAN Huaiyu. Check-in Trajectory and User Linking Based on Natural Language Augmentation [J]. Computer Science, 2025, 52(2): 99-106.
[4] ZHENG Mingqi, CHEN Xiaohui, LIU Bing, ZHANG Bing, ZHANG Ran. Survey of Chain-of-Thought Generation and Enhancement Methods in Prompt Learning [J]. Computer Science, 2025, 52(1): 56-64.
[5] MO Shuyuan, MENG Zuqiang. Multimodal Sentiment Analysis Model Based on Visual Semantics and Prompt Learning [J]. Computer Science, 2024, 51(9): 250-257.
[6] BAI Yu, WANG Xinzhe. Study on Hypernymy Recognition Based on Combined Training of Attention Mechanism and Prompt Learning [J]. Computer Science, 2024, 51(6A): 230700226-5.
[7] XU Yiran, ZHOU Yu. Prompt Learning Based Parameter-efficient Code Generation [J]. Computer Science, 2024, 51(6): 61-67.
[8] LIU Jun, RUAN Tong, ZHANG Huanhuan. Prompt Learning-based Generative Approach Towards Medical Dialogue Understanding [J]. Computer Science, 2024, 51(5): 258-266.
[9] XU Bei, XU Peng. Emotion Elicited Question Generation Model in Dialogue Scenarios [J]. Computer Science, 2024, 51(11): 265-272.
[10] HUANG Jiange, JIA Zhen, ZHANG Fan, LI Tianrui. Chinese Medical Named Entity Recognition Based on Multi-feature Embedding [J]. Computer Science, 2023, 50(6): 243-250.
[11] FU Ying, WANG Hong-ling, WANG Zhong-qing. Scientific Paper Summarization Using Word-Section Association [J]. Computer Science, 2021, 48(10): 59-66.
[12] ZHOU Ming,JIA Yan-ming,ZHOU Cai-lan,XU Ning. English Automated Essay Scoring Methods Based on Discourse Structure [J]. Computer Science, 2019, 46(3): 234-241.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!