Computer Science ›› 2026, Vol. 53 ›› Issue (6): 77-83.doi: 10.11896/jsjkx.250600160

• Intelligent Education Technology • Previous Articles     Next Articles

Generation of Programming Learning Situation Feedback Reports Based on Code Analysis

CUI Can, GAO Zhizezhang, CUI Lei, FENG Jun, SUN Xia   

  1. College of Computer Science,Northwest University,Xi'an 710127,China
  • Received:2025-06-24 Revised:2025-09-01 Online:2026-06-15 Published:2026-06-09
  • About author:CUI Can,born in 2001,postgraduate.Her main research interest is intelligent education.
    SUN Xia,born in 1977,Ph.D,professor,Ph.D supervisor,is a member of CCF(No.E200015067M).Her main research interests include intelligent education and natural language processing.
  • Supported by:
    Research Programon Teacher Education Reform and Teacher Development of Shaanxi Province(SJS2023ZD030)and Northwest University Talent Development Demonstration Course Reform Program(JX2024027).

Abstract: To address the limitations of traditional programming feedback,which relies heavily on outcome-based metrics and lacks fine-grained guidance,and to tackle the challenges of generalized application and insufficient guidance of large language mo-dels (LLMs) in educational contexts,this paper constructs an automated system for generating student learning reports based on code data.The system innovatively integrates static code quality analysis with multiple code submission records,and specifically employs a multi-role Agent collaborative model,optimized Chain-of-Thought (CoT) prompting strategies,and a hierarchical gene-ration mechanism to provide students with precise and comprehensive learning feedback.Through an empirical study using real student programming data,the results demonstrate that the system can effectively pinpoint specific issues in students' code,clearly revealing their problem-solving thought processes and knowledge gaps.Student evaluation feedback confirms that the generated learning reports exhibit excellent performance in terms of accuracy and practicality,showcasing significant application value and development potential in programming teaching practice.

Key words: Programming feedback, Static code analysis, Fine-grained report generation, Chain-of-Thought, Agent

CLC Number: 

  • TP399
[1]HAHN M G,NAVARRO S M B,DE-LA-FUENTE-VALENTÍN L.Lud:An automatic scoring and feedback system for programming assignments[C]//2022 International Conference on Advanced Learning Technologies(ICALT).IEEE,2022:384-386.
[2]WU H,ZHANG S,DING H,et al.Network-based recommendation analysis on online judge systems[C]//2022 15th International Congress on Image and Signal Processing,BioMedical Engineering and Informatics(CISP-BMEI).IEEE,2022:1-5.
[3]ÖSTLUND L,WICKLUND N,GLASSEY R.It's Never tooEarly to Learn About Code Quality:A Longitudinal Study of Code Quality in First-year Computer Science Students[C]//Proceedings of the 54th ACM Technical Symposium on Computer Science Education.2023:792-798.
[4]ZHANG Z,DONG Z,SHI Y,et al.Students' perceptions andpreferences of generative artificial intelligence feedback for programming[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2024:23250-23258.
[5]JAMALUDIN N H,ROMLI R.Analysis of the Effectiveness of Feedback Provision in Intelligent Tutoring Systems[C]//International Conference on Computing and Informatics.Singapore:Springer,2023:168-179.
[6]RAJ R,SABIN M,IMPAGLIAZZO J,et al.Professional competencies in computing education:pedagogies and assessment[C]//Proceedings of the 2021 Working Group Reports on Innovation and Technology in Computer Science Education.2021:133-161.
[7]SUN D,BOUDOUAIA A,ZHU C,et al.Would ChatGPT-facilitated programming mode impact college students' programming behaviors,performances,and perceptions? An empirical study[J].International Journal of Educational Technology in Higher Education,2024,21(1):14.
[8]SAFITRI S N,SETIADI H,SURYANI E.Educational data mining using cluster analysis methods and decision trees based on log mining[J].Jurnal RESTI(Rekayasa Sistem dan Teknologi Informasi),2022,6(3):448-456.
[9]ZHANG W,ZENG X,WANG J,et al.An analysis of learners' programming skills through data mining[J].Education and Information Technologies,2022,27(8):11615-11633.
[10]SHI Y,SCHMUCKER R,CHI M,et al.KC-Finder:Automated Knowledge Component Discovery for Programming Problems[C]//Proceedings of the International Conference on Educatio-nal Data Mining.2023:28-29.
[11]NGUYEN H,ALLAN V.Using GPT-4 to provide tiered,formative code feedback[C]//Proceedings of the 55th ACM Technical Symposium on Computer Science Education.2024:958-964.
[12]SONG T,ZHANG H,XIAO Y.A High-Quality Generation Approach for Educational Programming Projects Using LLM[J].IEEE Transactions on Learning Technologies,2024,17:2242-2255.
[13]WEI J,WANG X,SCHUURMANS D,et al.Chain-of-thoughtprompting elicits reasoning in large language models[J].Advances in Neural Information Processing Systems,2022,35:24824-24837.
[14]WANG X,WEI J,SCHUURMANS D,et al.Self-consistencyimproves chain of thought reasoning in language models[J].arXiv:2203.11171,2022.
[15]SHI Y,REN P,WANG J,et al.Leveraging GPT-4 for foodeffect summarization to enhance product-specific guidance deve-lopment via iterative prompting[J].Journal of Biomedical Informatics,2023,148:104533.
[16]KEUNING H,HEEREN B,JEURING J.How teachers would help students to improve their code[C]//Proceedings of the 2019 ACM Conference on Innovation and Technology in Computer Science Education.2019:119-125.
[17]HUANG L,YU W,MA W,et al.A survey on hallucination in large language models:Principles,taxonomy,challenges,and open questions[J].ACM Transactions on Information Systems,2025,43(2):1-55.
[18]GAO Z,CUI C,YAN H,et al.Towards a Quantitative Competency Model for CS1 via Five-Channel Learning Sequences[C]//Proceedings of the 56th ACM Technical Symposium on Compu-ter Science Education.2025:367-373.
[19]GUO D,YANG D,ZHANG H,et al.Deepseek-r1:Incentivizing reasoning capability in llms via reinforcement learning[J].ar-Xiv:2501.12948,2025.
[20]CHIANG S H,CHAO L W,WANG K D,et al.BADGE:BADminton report Generation and Evaluation with LLM[C]//AIJCAI 2024 Workshop:The 2nd International Workshop on Intelligent Technologies for Precision Sports Science(IT4PSS).2024:12-18.
[1] LIU Jiaqi, GAO Zhizezhang, MENG Xianjia, SUN Xia, FENG Jun. Automatic Knowledge Point Annotation for Student Code Based on Multi-agent Collaboration:A Case Study of C Language [J]. Computer Science, 2026, 53(6): 59-68.
[2] LIU Suyi, LIU Qi, GAO Weibo. Agent4Stu:Efficient LLM-based Student Answer Behavior Simulation Agent [J]. Computer Science, 2026, 53(4): 347-355.
[3] XU Jiawen, ZHENG Yungui, ZHOU Wei, XU Yaoqiang, HU Huiqi, ZHOU Xuan. SQL-MARS:Text-to-SQL Structured Data Recommendation System for Ambiguous UserRequirements [J]. Computer Science, 2026, 53(3): 52-63.
[4] XIE Guangqiang, QIU Fengyang, LI Yang. Fast Consensus Seeking in Distributed Multi-agent System Using Topology Virtual Structural Hole Node [J]. Computer Science, 2026, 53(2): 358-366.
[5] ZHAI Jie, LI Yanhao, CHEN Lexuan, GUO Weibin. Dynamic Recommendation of Personalized Hands-on Learning Materials Based on LightweightEducational LLMs [J]. Computer Science, 2026, 53(2): 48-56.
[6] DUAN Pengting, WEN Chao, WANG Baoping, WANG Zhenni. Collaborative Semantics Fusion for Multi-agent Behavior Decision-making [J]. Computer Science, 2026, 53(1): 252-261.
[7] GUO Luxiang, WANG Yueyu, LI Qianyue, LI Shasha, LIU Xiaodong, JI Bin, YU Jie. Comprehensive Survey of LLM-based Agent Operating Systems [J]. Computer Science, 2026, 53(1): 1-11.
[8] LIU Dayong, DONG Zhiming, GUO Qisheng, GAO Ang, QIU Xuehuan. Research on Architecture and Technology Pathways for Empowering Tactical AdversarialSimulation Experiments with LLMs [J]. Computer Science, 2026, 53(1): 39-50.
[9] ZHU Shihao, PENG Kexing, MA Tinghuai. Graph Attention-based Grouped Multi-agent Reinforcement Learning Method [J]. Computer Science, 2025, 52(9): 330-336.
[10] CHEN Jintao, LIN Bing, LIN Song, CHEN Jing, CHEN Xing. Dynamic Pricing and Energy Scheduling Strategy for Photovoltaic Storage Charging Stations Based on Multi-agent Deep Reinforcement Learning [J]. Computer Science, 2025, 52(9): 337-345.
[11] ZHANG Yongliang, LI Ziwen, XU Jiahao, JIANG Yuchen, CUI Ying. Congestion-aware and Cached Communication for Multi-agent Pathfinding [J]. Computer Science, 2025, 52(8): 317-325.
[12] SHI Xiaoyan, YUAN Peiyan, ZHANG Junna, HUANG Ting, GONG Yuejiao. Lifelong Multi-agent Task Allocation Based on Graph Coloring Hybrid Evolutionary Algorithm [J]. Computer Science, 2025, 52(7): 262-270.
[13] HUO Dan, YU Fuping, SHEN Di, HAN Xueyan. Research on Multi-machine Conflict Resolution Based on Deep Reinforcement Learning [J]. Computer Science, 2025, 52(7): 271-278.
[14] PIAO Mingjie, ZHANG Dongdong, LU Hu, LI Rupeng, GE Xiaoli. Study on Multi-agent Supply Chain Inventory Management Method Based on Improved Transformer [J]. Computer Science, 2025, 52(6A): 240500054-10.
[15] FU Shufan, WANG Zhongqing, JIANG Xiaotong. Zero-shot Stance Detection in Chinese by Fusion of Emotion Lexicon and Graph ContrastiveLearning [J]. Computer Science, 2025, 52(6A): 240500051-7.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!