Computer Science ›› 2026, Vol. 53 ›› Issue (6): 50-58.doi: 10.11896/jsjkx.250600151

• Intelligent Education Technology • Previous Articles     Next Articles

Multi-task Classroom Title Generation Method Integrates Core Sentences and Keyword Guidance

SHANG Yi, YING Di, ZHAO Hui   

  1. School of Computer Science and Technology,Xinjiang University,Urumqi 830046,China
  • Received:2025-06-24 Revised:2025-09-11 Online:2026-06-15 Published:2026-06-09
  • About author:SHANG Yi,born in 1995,postgraduate.His main research interests include artificial intelligence and natural language processing.
    ZHAO Hui,born in 1972,Ph.D,professor,Ph.D supervisor,is a member of CCF(No.25440S).Her main research interests include artificial intelligence,natural language processing,emotion computing,speech and digital image processing.
  • Supported by:
    Key R & D Program of Xinjiang Uygur Autonomous Region(2023B01032) and National Natural Science Foundation of China(62166041).

Abstract: Title generation,as a fundamental component of text generation tasks,frequently encounters challenges such as inadequate information coverage and semantic deviation.To address this issue,this paper proposes a multi-task title generation model guided by core sentences.This model emphasizes the critical role of core sentences in capturing the main idea of the source text and improving title generation quality.The model utilizes the original text,core sentences,and keywords as inputs,employing annotated core sentences during the training phase and acquiring them automatically through a core sentence classification task du-ring the testing phase.By integrating the training of core sentence classification and title generation,the model is capable of identi-fying key content while generating titles that more accurately align with the semantic meaning of the source text.Furthermore,to enhance the quality of generation,a similarity loss between keywords and titles is introduced to reinforce thematic consistency.During the decoding phase,the model explicitly distinguishes between two cognitive processes-content understanding and conceptual focus-in an educational context.It employs a dual cross-attention mechanism to generate concise,fluent,and highly summarized titles.Experimental results demonstrate that,within the multi-task framework,the outcomes of the core sentence classification task assist the title generation task.The presence of shared information enables collaborative optimization between tasks,leading to a substantial enhancement in title generation quality and providing novel insights for the automated construction of educational resources.

Key words: Title generation, Core sentences, Keywords, Multitask learning, Abstractive summarization

CLC Number: 

  • TP391
[1]BESNIK F,CHEN Z Y,OLEG R,et al.InstructPTS:Instruction-Tuning LLMs for Product Title Summarization[C]//Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing:Industry Track.Association for Computational Linguistics,2023:663-674.
[2]ZHANG X Y,JIANG Y J,SHANG Y,et al.DSGPT:Domain-specific generative pre-training of transformers for text generation in E-commerce title and review summarization[C]//Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR'21).New York:Association for Computing Machinery,2021:2146-2150.
[3]LI P,YU J,CHEN J,et al.HG-News:News Headline Generation Based on a Generative Pre-Training Model[J].IEEE Access,2021,9:107947-107957.
[4]BAE S,KIM T,KIM J,et al.Summary Level Training of Sentence Rewriting for Abstractive Summarization[C]//Procee-dings of the 2nd Workshop on New Frontiers in Summarization.Association for Computational Linguistics,2019:10-20.
[5]DOU Z Y,LIU P,HAYASHI H,et al.GSum:A GeneralFramework for Guided Neural Abstractive Summarization[C]//North American Chapter of the Association for Computational Linguistics.Association for Computational Linguistics,2021.
[6]LIN Y,LIU P.SimCLS:A Simple Framework for Contrastive Learning of Abstractive Summarization[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing(Volume 2:Short Papers).Association for Computational Linguistics,2021:1065-1072.
[7]YANG W C,GU T Y,SUI R Q.A Faster Method For Generating Chinese Text Summaries-Combining Extractive Summarization And Abstractive Summarization[C]//Proceedings of the 2022 5th International Conference on Machine Learning and Natural Language Processing(MLNLP '22).Association for Computing Machinery,New York,NY,USA,2022:54-58.
[8]JIAO L Y,GUO Y,LIU Y,et al.A Sequence Model for Single Document Headline Generation[J].Journal of Chinese Information Processing,2021,35(1):64-71.
[9]MIHALCEA R,TARAU P.TextRank:Bringing Order intoTexts[C]//Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing(EMNLP).2004.
[10]VO T.An approach of syntactical text graph representationlearning for extractive summarization[J].International Journal of Intelligent Robotics and Applications,2023,7:190-204.
[11]RAKROUKI M A,ALHARBE N R,KHAYYAT M,et al.TG-SMR:A Text Summarization Algorithm Based on Topic and Graph Models[J].Computer Systems Science and Engineering,2023,45(1):395-408.
[12]MALARSELVI G,PANDIAN A.Multi-layered network model for text summarization using feature representation[J].Soft Computing,2023,27(1):311-322.
[13]FEIJO D D,MOREIRA V P.Improving abstractive summarization of legal rulings through textual entailment[J].Artificial Intelligence and Law,2021,31(1):91-113.
[14]VO T.A novel semantic-enhanced generative adversarial net-work for abstractive text summarization[J].Soft Computing,2023,27:6267-6280.
[15]ZHANG J,ZHAO Y,SALEH M,et al.PEGASUS:Pre-training with Extracted Gap-sentences for Abstractive Summarization[C]//International Conference on Machine Learning.PMLR,2020.
[16]LEWIS M,LIU Y,GOYAL N,et al.BART:Denoising Se-quence-to-Sequence Pre-training for Natural Language Generation,Translation,and Comprehension[C]//58th Annual Mee-ting of the Association for Computational Linguistics.Association for Computational Linguistics,2020.
[17]RAFFEL C,SHAZEER N,ROBERTS A,et al.Exploring the limits of transfer learning with aunified text-to-text transformer[J].Journal of machine learning research,2020,21(140):1-67.
[18]SONG K,WANG B,FENG Z,et al.Controlling the Amount of Verbatim Copying in Abstractive Summarization[C]//National Conference on Artificial Intelligence.Association for the Advancement of Artificial Intelligence(AAAI),2020.
[19]KOSUKE Y,YUTA H,HIDEAKI T,et al.Transformer-based Lexically Constrained Headline Generation[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.Association for Computational Linguistics,2021.
[20]JONES K S.Indexterm weighting[J].Information Storage &Retrieval,1973,9(11):619-633.
[21]RADA M,PAUL T.TextRank:Bringing Order into Text[C]//Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing.Association for Computational Linguistics,2024.
[22]DAVID M,BLE I,ANDREW Y,et al.Latent dirichlet allocation[J].The Journal of Machine Learning Research,2003,3:993-1022.
[23]XIAO S Y,ZHAO H.Title generation of knowledge points for classroom teaching[J].Journal of Tsinghua University(Science and Technology),2023,64(5):770-779.
[24]LEWIS M,LIU Y,GOYAL N,et al.BART:denoising sequence-to-sequence pre-training for natural language generation,translation,and comprehension [C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.Association for Computational Linguistics,2020.
[25]DONG L,YANG N,WANG W H,et al.Unified language model pre-training for natural language understanding and generation[C]//Proceedings of the 33rd International Conference on Neural Information Processing Systems.Curran Associates Inc.,2019:13063-13075.
[26]XUE L,CONSTANT N,ROBERTS A,et al.mT5:A massively multilingual pretrained text-to-text transformer[J].arXiv:2010.11934,2020.
[1] MAO Xingjing, WEI Yong, YANG Yurui, JU Shenggen. KHGAS:Keywords Guided Heterogeneous Graph for Abstractive Summarization [J]. Computer Science, 2024, 51(7): 278-286.
[2] LI Junlin, OUYANG Zhi, DU Nisuo. Scene Text Detection with Improved Region Proposal Network [J]. Computer Science, 2023, 50(2): 201-208.
[3] YU Jia-qi, KANG Xiao-dong, BAI Cheng-cheng, LIU Han-qing. New Text Retrieval Model of Chinese Electronic Medical Records [J]. Computer Science, 2022, 49(6A): 32-38.
[4] GUO Yu-xin, CHEN Xiu-hong. Automatic Summarization Model Combining BERT Word Embedding Representation and Topic Information Enhancement [J]. Computer Science, 2022, 49(6): 313-318.
[5] GAO Shi-yao, CHEN Yan-li, XU Yu-lan. Expressive Attribute-based Searchable Encryption Scheme in Cloud Computing [J]. Computer Science, 2022, 49(3): 313-321.
[6] MAO Xiang-ke, HUANG Shao-bin, YU Qin-yong. Graph Based Collaborative Extraction Method for Keywords and Summary from Documents [J]. Computer Science, 2021, 48(10): 44-50.
[7] FU Ying, WANG Hong-ling, WANG Zhong-qing. Scientific Paper Summarization Using Word-Section Association [J]. Computer Science, 2021, 48(10): 59-66.
[8] XU Zhe, LIU Liang, QIN Xiao-lin, QIN Wei-meng. Distributed Spatial Keyword Query Processing Algorithm with Relational Attributes [J]. Computer Science, 2019, 46(6A): 402-406.
[9] LIU Xin-yu, LI Lang, XIAO Bing-bing. Attribute-based Proxy Re-encryption Technology and Fault-tolerant Mechanism Based Data Retrieval Scheme [J]. Computer Science, 2018, 45(7): 162-166.
[10] YANG Yue and ZHANG De-sheng. Technology of Extracting Topical Keyphrases from Chinese Corpora [J]. Computer Science, 2017, 44(Z11): 432-436.
[11] DONG Yuan and QIAN Li-ping. Text Similarity Calculation Based on Semantic Dictionary and Word Frequency Information [J]. Computer Science, 2017, 44(Z11): 422-427.
[12] ZHENG Bu-qing, ZOU Hong-xia, HU Xin-jie and WANG Zhen. Research on Evolution of Network Public Opinion Introducing Time Mechanism [J]. Computer Science, 2017, 44(Z11): 418-421.
[13] GE Wei-yi, ZONG Shi-qiang and YIN Wen-ke. Keyword Search for Relational Databases Based on Offline Index [J]. Computer Science, 2016, 43(4): 182-187.
[14] FANG Zhong-jin, ZHOU Shu and XIA Zhi-hua. Research on Fuzzy Search over Encrypted Cloud Data Based on Keywords [J]. Computer Science, 2015, 42(3): 136-139.
[15] HUANG Lei,WU Yan-peng and ZHU Qun-feng. Research and Improvement of TFIDF Text Feature Weighting Method [J]. Computer Science, 2014, 41(6): 204-207.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!