计算机科学 ›› 2026, Vol. 53 ›› Issue (6): 84-92.doi: 10.11896/jsjkx.250600155

• 智能教育技术 • 上一篇    下一篇

基于关系学习的记忆网络知识追踪模型

许智宏1,2,3, 杨鑫磊1, 王利琴1,2,3, 董永峰1,2,3, 王旭1,2,3   

  1. 1 河北工业大学人工智能与数据科学学院 天津 300401
    2 河北省大数据计算重点实验室 天津 300401
    3 河北省数据驱动工业智能工程研究中心 天津 300401
  • 收稿日期:2025-06-24 修回日期:2025-09-08 出版日期:2026-06-15 发布日期:2026-06-09
  • 通讯作者: 王利琴(283900335@qq.com)
  • 作者简介:(1474539920@qq.com)
  • 基金资助:
    河北省高等学校科学技术研究项目(ZD2022082);河北省高等教育教学改革研究与实践项目(2022GJJG049);国家自然科学基金(62402160);河北省自然科学基金(F2024202078)

Knowledge Tracing Model Based on Relational Learning Memory Network

XU Zhihong1,2,3, YANG Xinlei1, WANG Liqin1,2,3, DONG Yongfeng1,2,3, WANG Xu1,2,3   

  1. 1 School of Artificial Intelligence,Hebei University of Technology,Tianjin 300401,China
    2 Hebei Key Laboratory of Big Data Computing,Tianjin 300401,China
    3 Hebei Engineering Research Center of Data-Driven Industrial Intelligent,Tianjin 300401,China
  • Received:2025-06-24 Revised:2025-09-08 Published:2026-06-15 Online:2026-06-09
  • About author:XU Zhihong,born in 1970,Ph.D,professor.Her main research interests include knowledge graph and intelligent education.
    WANG Liqin,born in 1980,Ph.D,experimentalist.Her main research in-terests include intelligent information processing and knowledge graph.
  • Supported by:
    Hebei Higher Education Institutions Science and Technology Research Project(ZD2022082),Hebei Higher Education Teaching Reform Research and Practice Project(2022GJJG049),National Natural Science Foundation of China(62402160) and Natural Science Foundation of Hebei Province(F20242078).

摘要: 知识追踪技术,即根据学生过去的答题信息建模,准确预测学生对各知识概念的掌握程度和未来学习表现,成为构建智能教育系统的核心和关键。随着深度学习的发展,知识追踪的研究方法越来越多,但是问题与知识点之间的关系复杂且隐晦,在缺乏专家标注的条件下,模型难以准确挖掘其潜在的关系特征。针对现有方法在问题和知识点间关系建模能力不足及模型可解释性差的问题,提出了基于关系学习的记忆网络知识追踪模型MKTRL。首先,模型使用多层Transformer组成的自监督关系学习模块,有效建模问题与知识点间的关系特征,并且结合动态多头注意力提取问题序列中的关键信息,提升模型对序列中长期依赖的处理能力;然后,使用双矩阵的知识记忆存储模块动态建模学生对每个知识点的掌握状态,并进行学习表现预测;最后,使用基于PGD的对抗训练方法生成对抗样本进行联合训练,提升模型的泛化能力。在3个知识追踪数据集上与7个代表模型的对比实验表明,MKTRL在AUC与ACC指标上均有提升,多维度实验进一步验证了该模型的预测有效性。

关键词: 知识追踪, 关系学习, 对抗训练, 记忆增强神经网络, 注意力机制, 智慧教育

Abstract: Knowledge tracking technology,which models students' past response information to accurately predict their mastery of various knowledge concepts and future learning performance,has become the core and key of building intelligent educational systems.With the development of deep learning,research methods for knowledge tracking have become increasingly diverse.However,the relationship between questions andknowledge points is complex and implicit,making it difficult for models to accurately uncover their underlying relational features in the absence of expert annotations.To address the limitations of existing methods in modeling the relationship between questions and knowledge points and their poor interpretability,this paper proposes a memory-augmented knowledge tracing model based on relational learning.Firstly,the model employs a self-supervised relational learning module composed of multi-layer Transformers to effectively model the relational features between questions and know-ledge points.It also incorporates dynamic multi-head attention to extract key information from question sequences,enhancing the model's ability to handle long-term dependencies in sequences.Then,a dual-matrix knowledge memory storage module is used to dynamically model students' mastery state of each knowledge point and predict their learning performance.Finally,a PGD-based adversarial training method is applied to generate adversarial samples for joint training,improving the model's generalization abi-lity.Comparative experiments with seven representative models on three knowledge tracking datasets demonstrate that MKTRL achieves improvements in both AUC and ACC metrics.Multi-dimensional experiments further validate the predictive effectiveness of the proposed mode.

Key words: Knowledge tracking, Relational learning, Adversarial training, Memory-enhancing neural networks, Attention mechanism, Intelligent education

中图分类号: 

  • TP391
[1]LIU Y H,LUO X Z,WU J H,et al.A personalised online lear-ning service model for primary and secondary schools based on knowledge map[J].Computer Science and Applications,2021,11(6):1834-1843.
[2]WU S X,LUO X Z,XIONG J,et al.Review on Research ofKnowledge Tracking[J].Journal of Frontiers of Computer Science and Technology,2023,17(7):1506-1525.
[3]PIECH C,SPENCER J,HUANG J,et al.Deep knowledge tra-cing[J].Computer Science,2015,3(3):19-23.
[4]MIENYE I D,SWART T G,OBAIDO G.Recurrent neural networks:a comprehensive review of architectures,variants,and applications[J].Information,2024,15(9):517.
[5]LIU Q,WANG Q.RVFL-LSTM:a lightweight model withlong-short term memory for time series[J].Knowledge-Based Systems,2025,309:112896.
[6]MINN S,YU Y,DESMARAIS M C,et al.Deep knowledge tra-cing and dynamic student classification for knowledge tracing[C]//Proceedings of the 18th IEEE International Conference on Data Mining Workshops.IEEE,2018:1182-1187.
[7]SU Y,LIU Q,LIU Q,et al.Exercise-enhanced sequential modeling for student performance prediction[C]//Proceedings of the AAAI Conference on Artificial Intelligence.AAAI,2018:2435-2443.
[8]LIU Q,HUANG Z,YIN Y,et al.EKT:exercise-aware know-ledge tracing for student performance prediction[J].IEEE Transaction on Knowledge and Data Engineering,2019,33(1):100-115.
[9]ZHANG M,ZHU X,ZHANG C,et al.Multi-factors aware dual-attentional knowledge tracing[C]//Proceedings of the 30th ACM International Conference on Information and Knowledge Management.New York:ACM,2021:2588-2597.
[10]GUO X P,HUANG Z J,GAO J,et al.Enhancing knowledgetracing via adversarial training[C]//Proceedings of the 29th ACM International Conference on Multimedia.New York:ACM,2021:367-375.
[11]ZHANG J,SHI X,KING I,et al.Dynamic key-value memorynetworks for knowledge tracing[C]//Proceedings of the 26th International Conference on World Wide Web.ACM,2017:765-774.
[12]SANTORO A,BARTUNOV S,BOTVINICK M,et al.Meta-learning with memory-augmented neural networks[C]//Proceedings of the 33th International Conference on Machine Learning.New York:JMLR,2016:1842-1850.
[13]SUN X,ZHAO X,MA Y,et al.Muti-behavior features basedknowledge tracking using decision tree improved DKVMN[C]//Proceedings of the ACM Turing Celebration Conference-China.ACM,2019:1-6.
[14]SUN X,ZHAO X,LI B,et al.Dynamic key-value memory networks with rich features for knowledge tracing[J].IEEE Transactions on Cybernetics,2021,52(8):8239-8245.
[15]ZHANG F,JIANG T T.DKVMN-PLC:a dynamic key-valuememory network knowledge tracking model incorporating learners' personalized lear-ning characteristics[J].Small Microcomputer Systems,2024,45(5):1272-1280.
[16]CHOI Y,LEE Y,CHO J,et al.Towards an appropriate query,key,and value computation for knowledge tracing[C]//Procee-dings of the Seventh ACM Conference on Learning@ Scale.ACM,2020:341-344.
[17]XING J Q,LI K X,WU Y H,et al.Convolution attentiveknowledge tracing with comprehensive behavioral features[C]//Proceedings of the ACM Turing Award Celebration Conference.ACM,2024:48-52.
[18]AI L M,ZHANG X Y.Attention model based on one-dimensional residual convolutional autoencoder and GRU for know-ledge tracing[J].Multimedia Tools and Applications,2025,84:23725-23732.
[19]NAKAGAWA H,IWASAWA Y,MATSUO Y.Graph-basedknowledge tracing:modeling student proficiency using graph neural network[C]//Proceedings of the 2019 IEEE/WIC/ACM International Conference on Web Intelligence.ACM,2019:156-163.
[20]YANG Y,SHEN J,QU Y,et al.GIKT:a graph-based interaction model for knowledge tracing[C]//Proceedings of the Machine Learning and Knowledge Discovery in Databases.Sprin-ger,2021:299-315.
[21]NI Q,WEI T,ZHAO J,et al.HHSKT:a learner-question interactions based heterogeneous graph neural network model for knowledge tracing[J].Expert Systems with Applications,2022,11(23):203-235.
[22]SONG X,LI J,TANG Y,et al.JKT:a joint graph convolutional network based deep knowledge tracing[J].Information Sciences,2021,580:510-523.
[23]WU Z,HUANG L,HUANG Q,et al.SGKT:session graph-based knowledge tracing for student performance prediction[J].Expert Systems with Applications,2022,206:1302-1334.
[24]SONG X,LI J,LEI Q,et al.Bi-CLKT:bi-graph contrastivelearning-based knowledge tracing[J].Knowledge-Based Systems,2022,241:108-146.
[25]MADRY A,MAKELOV A,SCHMIDT L,et al.Towards deep learning models resistant to adversarial attacks[C]//Procee-dings of the 6th Conference on International Conference on Learning Representations.2018:1-27.
[26]DA X,MENG Q Y,LI S P,et al.Improving transformers with dynamically composable multi-head attention[C]//Proceedings of the 41st International Conference on Machine Learning.JMLR.org,2024:54300-54318.
[27]XIONG X,ZHAO S,VAN E G,et al.Going deeper with deep knowledge tracing[C]//Proceedings of the 9th International Conference on Educational Data Mining.ICEDM,2016:545-550.
[28]CHOI Y D,LEE Y N,SHIN D M,et al.EdNet:a large-scale hierarchical dataset in education[J].Lecture Notes in Computer Science,Artificial Intelligence in Education,2020,12:69-73.
[29]GHOSH A,HEFFERNAN N,LAN A S.Context-aware attentive knowledge tracing[C]//Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.ACM,2020:2330-2339.
[30]MA Y,HAN P,QIAO H,et al.SPAKT:a self-supervised pre-training method for knowledge tracing[J].IEEE Access,2022,10:72145-72154.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!