Context-Aware and Data-Driven Feedback Generation for Programming Assignments
Thu 26 Aug 2021 21:10 - 21:20 - Testing—Program Repair 1 Chair(s): Lingming Zhang
Recently, various techniques have been proposed to automatically provide personalized feedback on programming exercises. The cutting edge of which is the data-driven approaches that leverage a corpus of existing correct programs and repair incorrect submissions by using similar reference programs in the corpus. However, current data-driven techniques work under the strong assumption that the corpus contains a solution program that is close enough to the incorrect submission.
In this paper, we present $\textsc{Cafe}$, a new data-driven approach for feedback generation that overcomes this limitation. Unlike existing approaches, $\textsc{Cafe}$ uses a novel context-aware repair algorithm that can generate feedback even if the incorrect program differs significantly from the reference solutions. We implemented $\textsc{Cafe}$ for OCaml and evaluated it with 4,211 real student programs. The results show that $\textsc{Cafe}$ is able to repair 83% of incorrect submissions, far outperforming existing approaches.
Thu 26 AugDisplayed time zone: Athens change
09:00 - 10:00 | Testing—Program Repair 1Research Papers / Journal First +12h Chair(s): Santanu Dash University of Surrey | ||
09:00 10mPaper | Beyond Tests: Program Vulnerability Repair via Crash Constraint Extraction Journal First Xiang Gao National University of Singapore, Bo Wang Peking University, China, Gregory J. Duck National University of Singapore, Ruyi Ji Peking University, Yingfei Xiong Peking University, Abhik Roychoudhury National University of Singapore | ||
09:10 10mPaper | Context-Aware and Data-Driven Feedback Generation for Programming Assignments Research Papers DOI | ||
09:20 10mPaper | A Syntax-Guided Edit Decoder for Neural Program Repair Research Papers Qihao Zhu Peking University, Zeyu Sun Peking University, Yuan-An Xiao Peking University, Wenjie Zhang Peking University, Kang Yuan Stony Brook University, Yingfei Xiong Peking University, Lu Zhang Peking University DOI | ||
09:30 30mLive Q&A | Q&A (Testing—Program Repair 1) Research Papers |
21:00 - 22:00 | Testing—Program Repair 1Research Papers / Journal First Chair(s): Lingming Zhang University of Illinois at Urbana-Champaign | ||
21:00 10mPaper | Beyond Tests: Program Vulnerability Repair via Crash Constraint Extraction Journal First Xiang Gao National University of Singapore, Bo Wang Peking University, China, Gregory J. Duck National University of Singapore, Ruyi Ji Peking University, Yingfei Xiong Peking University, Abhik Roychoudhury National University of Singapore | ||
21:10 10mPaper | Context-Aware and Data-Driven Feedback Generation for Programming Assignments Research Papers DOI | ||
21:20 10mPaper | A Syntax-Guided Edit Decoder for Neural Program Repair Research Papers Qihao Zhu Peking University, Zeyu Sun Peking University, Yuan-An Xiao Peking University, Wenjie Zhang Peking University, Kang Yuan Stony Brook University, Yingfei Xiong Peking University, Lu Zhang Peking University DOI | ||
21:30 30mLive Q&A | Q&A (Testing—Program Repair 1) Research Papers |