计算机科学 ›› 2026, Vol. 53 ›› Issue (6): 59-68.doi: 10.11896/jsjkx.250600150
刘佳琦, 高志泽樟, 孟宪佳, 孙霞, 冯筠
LIU Jiaqi, GAO Zhizezhang, MENG Xianjia, SUN Xia, FENG Jun
摘要: 在智能教育系统中,知识点标注是实现教学资源组织、个性化推荐与学生认知状态建模的关键模块。然而,传统以习题为导向的知识点标注方法存在局限性,难以反映学生在编程过程中展现的个体差异。为此,提出了一种基于多智能体协作的学生代码知识点自动标注方法。该方法从习题导向转向代码导向,构建了涵盖语句层、代码块层与函数层的三层次知识点体系,并设计了由知识点标注、任务分析与整合反馈3个智能体组成的协作系统,该系统具备内部自检与迭代优化能力。实验基于基础编程课程的363份学生代码样本展开,在真实教学案例中展现出对学生知识点标注的良好的解释性与群体分析能力,能够有效揭示学生的知识掌握情况与典型认知缺陷。此外,该研究采用基于大语言模型(LLM)评审机制的评判方法进行评估。结果表明,多智能体协作方法在五维度(完整性、准确性、合理性、错误识别能力和教育指导性)的评分均优于直接采用LLM的方法,且被选为最佳方案的次数显著更多。研究实现了对学生代码知识点的自动化标注与可解释性,为细粒度学生建模、个性化评估等下游任务提供了技术支撑与实践基础。
中图分类号:
| [1]CHEN J M,CHEN M C,SUN Y S.A tag based learning approach to knowledge acquisition for constructing prior know-ledge and enhancing student reading comprehension[J].Compu-ters & Education,2014,70:256-268. [2]ZHONG M,DING R.Design of a personalized recommendation system for learning resources based on collaborative filtering[J].International Journal of Circuits,Systems and Signal Processing,2022,16(1):122-31. [3]LIU Z,GUO T,LIANG Q,et al.Deep Learning Based Know-ledge Tracing:A Review,A Tool and Empirical Studies[J].IEEE Transactions on Knowledge and Data Engineering,2025,37(8):4512-4536. [4]CHAO P Y.Exploring students' computational practice,design and performance of problem-solving through a visual programming environment[J].Computers & Education,2016,95:202-215. [5]POULSEN S,KULKARNI S,HERMAN G,et al.EfficientFeedback and Partial Credit Grading for Proof Blocks Problems[C]//International Conference on Artificial Intelligence in Education.Cham:Springer Nature Switzerland,2023:502-514. [6]ALON U,ZILBERSTEIN M,LEVY O,et al.code2vec:Lear-ning distributed representations of code[J].Proceedings of the ACM on Programming Languages,2019,3(POPL):1-29. [7]GAO Z,YAN H,LIU J,et al.Tracing distinct learning trajectories in introductory programming course:a sequence analysis of score,engagement,and code metrics for novice computer science vs.math cohorts[J].International Journal of STEM Education,2025,12(1):1-26. [8]SHI Y,CHI M,BARNES T,et al.Evaluating Multi-Knowledge Component Interpretability of Deep Knowledge Tracing Models in Programming[C]//Proceedings of the 17th International Conference on Educational Data Mining.2024:288-295. [9]WU Y,ZHU H,WANG C,et al.Programming knowledge tracing based on heterogeneous graph representation[J].Know-ledge-Based Systems,2024,300:112161. [10]HAN S,WANG Y,LU X.Errorclr:semantic error classifica-tion,localization and repair for introductory programming assignments[C]//Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval.2023:1345-1354. [11]NGUYEN H,ALLAN V.Using GPT-4 to provide tiered,formative code feedback[C]//Proceedings of the 55th ACM Technical Symposium on Computer Science Education V.1.2024:958-964. [12]RATNER A,BACH S H,EHRENBERG H,et al.Snorkel:Ra-pid training data creation with weak supervision[C]//Procee-dings of the VLDB Endowment.International Conference on VeryLarge Data Bases.2017:269. [13]GUO S,LATIF E,ZHOU Y,et al.Using Generative AI and Multi-Agents to Provide Automatic Feedback[J].arXiv:2411.07407,2024. [14]LI X,WANG S,ZENG S,et al.A survey on LLM-based multi-agent systems:workflow,infrastructure,and challenges[J].Vi-cinagearth,2024,1(1):9. [15]GUO T,CHEN X,WANG Y,et al.Large language model based multi-agents:A survey of progress and challenges[J].arXiv:2402.01680,2024. [16]ZHANG Z,ZHANG L D,YU J,et al.Simulating classroomeducation with llm-empowered agents[J].arXiv:2406.19226,2024. [17]SONG T,ZHANG H,XIAO Y.A High-Quality Generation Approach for Educational Programming Projects Using LLM[J].IEEE Transactions on Learning Technologies,2024(17):2242-2255. [18]LI H,XU T,CHANG E,et al.Knowledge tagging with large language model based multi-agent system[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2025:28775-28782. [19]LI H,XU T,TANG J,et al.Automate knowledge concept tagging on math questions with LLMs[J].arXiv:2403.17281,2024. [20]SUN B,ZHU Y,XIAO Y,et al.Automatic question taggingwith deep neural networks[J].IEEE Transactions on Learning Technologies,2018,12(1):29-43. [21]LIU Q,HUANG Z,YIN Y,et al.Ekt:Exercise-aware know-ledge tracing for student performance prediction[J].IEEE Transactions on Knowledge and Data Engineering,2019,33(1):100-115. [22]HUANG Z,LIU Q,GAO W,et al.Neural mathematical solver with enhanced formula structure[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval.2020:1729-1732. [23]WANG J,LI H,DU X,et al.S-kmn:Integrating semantic features learning and knowledge mapping network for automatic quiz question annotation[J].Journal of King Saud University-Computer and Information Sciences,2023,35(7):101594. [24]DING Z,WANG X,WU Y,et al.Tagging knowledge concepts for math problems based on multi-label text classification[J].Expert Systems with Applications,2025,267:126232. [25]HUANG T,HU S,YANG H,et al.PQSCT:Pseudo-siameseBERT for concept tagging with both questions and solutions[J].IEEE Transactions on Learning Technologies,2023,16(5):831-846. [26]MOORE S,SCHMUCKER R,MITCHELL T,et al.Automated generation and tagging of knowledge components from multiple-choice questions[C]//Proceedings of the Eleventh ACM Confe-rence on Learning@ scale.2024:122-133. [27]LI H,XU T,TANG J,et al.Knowledge tagging system on math questions via llms with flexible demonstration retriever[J].ar-Xiv:2406.13885,2024. [28]MEHTA N,TERUEL M,DENG X,et al.Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback[C]//Findings of the Association for Computational Linguistics:EACL 2024.2024:1306-1321. [29]LAGAKIS P,DEMETRIADIS S.EvaAI:a multi-agent frame-work leveraging large language models for enhanced automated grading[C]//International Conference on Intelligent Tutoring Systems.Cham:Springer Nature Switzerland,2024:378-385. [30]YANG K,CHU Y,DARWIN T,et al.Content knowledge identification with multi-agent large language models(LLMs)[C]//International Conference on Artificial Intelligence in Education.Cham:Springer Nature Switzerland,2024:284-292. [31]FENG J,WU T,LU X,et al.Exploration and Practice of Agile Teaching Methods in the Basic Programming Course [J].Journal of Computer Education,2019(8):81-87. [32]LI R,KANG J,LIU Q,et al.MGS3:A Multi-Granularity Self-Supervised Code Search Framework[C]//Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1.2025:695-706. [33]MADAAN A,TANDON N,GUPTA P,et al.Self-refine:Iterative refinement with self-feedback[J].Advances in Neural Information Processing Systems,2023,36:46534-46594. [34]ZHENG L,CHIANG W L,SHENG Y,et al.Judging llm-as-a-judge with mt-bench and chatbot arena[J].Advances in Neural Information Processing Systems,2023,36:46595-46623. |
|
||