计算机科学 ›› 2026, Vol. 53 ›› Issue (6): 77-83.doi: 10.11896/jsjkx.250600160

• 智能教育技术 • 上一篇    下一篇

基于代码分析的编程学情反馈报告生成

崔灿, 高志泽樟, 崔磊, 冯筠, 孙霞   

  1. 西北大学计算机学院 西安 710127
  • 收稿日期:2025-06-24 修回日期:2025-09-01 出版日期:2026-06-15 发布日期:2026-06-09
  • 通讯作者: 孙霞(raindy@nwu.edu.cn)
  • 作者简介:(cuican@stumail.nwu.edu.cn)
  • 基金资助:
    陕西省教师教育改革与教师发展研究项目(SJS2023ZD030);西北大学人才培养示范课程改革项目(JX2024027)

Generation of Programming Learning Situation Feedback Reports Based on Code Analysis

CUI Can, GAO Zhizezhang, CUI Lei, FENG Jun, SUN Xia   

  1. College of Computer Science,Northwest University,Xi'an 710127,China
  • Received:2025-06-24 Revised:2025-09-01 Published:2026-06-15 Online:2026-06-09
  • About author:CUI Can,born in 2001,postgraduate.Her main research interest is intelligent education.
    SUN Xia,born in 1977,Ph.D,professor,Ph.D supervisor,is a member of CCF(No.E200015067M).Her main research interests include intelligent education and natural language processing.
  • Supported by:
    Research Programon Teacher Education Reform and Teacher Development of Shaanxi Province(SJS2023ZD030)and Northwest University Talent Development Demonstration Course Reform Program(JX2024027).

摘要: 为解决传统编程反馈依赖结果性指标,无法提供细粒度指导,以及大语言模型在教育场景中应用泛化、引导不足等难题,构建了一个基于代码数据的学情报告自动生成系统。该系统创新性地融合了静态代码质量分析与多次代码提交记录,并针对性地采用多角色智能体(Agent)协作模式、优化的思维链(CoT)提示策略与分层生成机制,旨在为学生提供精准、全面的学情反馈。对真实学生编程数据的实证研究结果表明,该系统能够有效定位学生代码中的具体问题,清晰地呈现其解题思维路径与知识盲区。学生评估反馈证实,生成的学情报告在准确性、实用性等方面表现优异,于编程教学实践中展现出显著的应用价值与发展潜力。

关键词: 编程反馈, 静态代码分析, 细粒度报告生成, 思维链, 智能体

Abstract: To address the limitations of traditional programming feedback,which relies heavily on outcome-based metrics and lacks fine-grained guidance,and to tackle the challenges of generalized application and insufficient guidance of large language mo-dels (LLMs) in educational contexts,this paper constructs an automated system for generating student learning reports based on code data.The system innovatively integrates static code quality analysis with multiple code submission records,and specifically employs a multi-role Agent collaborative model,optimized Chain-of-Thought (CoT) prompting strategies,and a hierarchical gene-ration mechanism to provide students with precise and comprehensive learning feedback.Through an empirical study using real student programming data,the results demonstrate that the system can effectively pinpoint specific issues in students' code,clearly revealing their problem-solving thought processes and knowledge gaps.Student evaluation feedback confirms that the generated learning reports exhibit excellent performance in terms of accuracy and practicality,showcasing significant application value and development potential in programming teaching practice.

Key words: Programming feedback, Static code analysis, Fine-grained report generation, Chain-of-Thought, Agent

中图分类号: 

  • TP399
[1]HAHN M G,NAVARRO S M B,DE-LA-FUENTE-VALENTÍN L.Lud:An automatic scoring and feedback system for programming assignments[C]//2022 International Conference on Advanced Learning Technologies(ICALT).IEEE,2022:384-386.
[2]WU H,ZHANG S,DING H,et al.Network-based recommendation analysis on online judge systems[C]//2022 15th International Congress on Image and Signal Processing,BioMedical Engineering and Informatics(CISP-BMEI).IEEE,2022:1-5.
[3]ÖSTLUND L,WICKLUND N,GLASSEY R.It's Never tooEarly to Learn About Code Quality:A Longitudinal Study of Code Quality in First-year Computer Science Students[C]//Proceedings of the 54th ACM Technical Symposium on Computer Science Education.2023:792-798.
[4]ZHANG Z,DONG Z,SHI Y,et al.Students' perceptions andpreferences of generative artificial intelligence feedback for programming[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2024:23250-23258.
[5]JAMALUDIN N H,ROMLI R.Analysis of the Effectiveness of Feedback Provision in Intelligent Tutoring Systems[C]//International Conference on Computing and Informatics.Singapore:Springer,2023:168-179.
[6]RAJ R,SABIN M,IMPAGLIAZZO J,et al.Professional competencies in computing education:pedagogies and assessment[C]//Proceedings of the 2021 Working Group Reports on Innovation and Technology in Computer Science Education.2021:133-161.
[7]SUN D,BOUDOUAIA A,ZHU C,et al.Would ChatGPT-facilitated programming mode impact college students' programming behaviors,performances,and perceptions? An empirical study[J].International Journal of Educational Technology in Higher Education,2024,21(1):14.
[8]SAFITRI S N,SETIADI H,SURYANI E.Educational data mining using cluster analysis methods and decision trees based on log mining[J].Jurnal RESTI(Rekayasa Sistem dan Teknologi Informasi),2022,6(3):448-456.
[9]ZHANG W,ZENG X,WANG J,et al.An analysis of learners' programming skills through data mining[J].Education and Information Technologies,2022,27(8):11615-11633.
[10]SHI Y,SCHMUCKER R,CHI M,et al.KC-Finder:Automated Knowledge Component Discovery for Programming Problems[C]//Proceedings of the International Conference on Educatio-nal Data Mining.2023:28-29.
[11]NGUYEN H,ALLAN V.Using GPT-4 to provide tiered,formative code feedback[C]//Proceedings of the 55th ACM Technical Symposium on Computer Science Education.2024:958-964.
[12]SONG T,ZHANG H,XIAO Y.A High-Quality Generation Approach for Educational Programming Projects Using LLM[J].IEEE Transactions on Learning Technologies,2024,17:2242-2255.
[13]WEI J,WANG X,SCHUURMANS D,et al.Chain-of-thoughtprompting elicits reasoning in large language models[J].Advances in Neural Information Processing Systems,2022,35:24824-24837.
[14]WANG X,WEI J,SCHUURMANS D,et al.Self-consistencyimproves chain of thought reasoning in language models[J].arXiv:2203.11171,2022.
[15]SHI Y,REN P,WANG J,et al.Leveraging GPT-4 for foodeffect summarization to enhance product-specific guidance deve-lopment via iterative prompting[J].Journal of Biomedical Informatics,2023,148:104533.
[16]KEUNING H,HEEREN B,JEURING J.How teachers would help students to improve their code[C]//Proceedings of the 2019 ACM Conference on Innovation and Technology in Computer Science Education.2019:119-125.
[17]HUANG L,YU W,MA W,et al.A survey on hallucination in large language models:Principles,taxonomy,challenges,and open questions[J].ACM Transactions on Information Systems,2025,43(2):1-55.
[18]GAO Z,CUI C,YAN H,et al.Towards a Quantitative Competency Model for CS1 via Five-Channel Learning Sequences[C]//Proceedings of the 56th ACM Technical Symposium on Compu-ter Science Education.2025:367-373.
[19]GUO D,YANG D,ZHANG H,et al.Deepseek-r1:Incentivizing reasoning capability in llms via reinforcement learning[J].ar-Xiv:2501.12948,2025.
[20]CHIANG S H,CHAO L W,WANG K D,et al.BADGE:BADminton report Generation and Evaluation with LLM[C]//AIJCAI 2024 Workshop:The 2nd International Workshop on Intelligent Technologies for Precision Sports Science(IT4PSS).2024:12-18.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!