Fri 27 Aug 2021 00:10 - 00:20 - Testing—Program Repair 2 Chair(s): Tien N. Nguyen
In this paper, we do automatic correctness assessment for patches generated by program repair systems. We consider the human-written patch as ground truth oracle and randomly generate tests based on it, a technique proposed by Shamshiri et al., called Random testing with Ground Truth (RGT) in this paper. We build a curated dataset of 638 patches for Defects4J generated by 14 state-of-the-art repair systems, we evaluate automated patch assessment on this dataset. The results of this study are novel and significant: First, we improve the state of the art performance of automatic patch assessment with RGT by 190% by improving the oracle; Second, we show that RGT is reliable enough to help scientists to do overfitting analysis when they evaluate program repair systems; Third, we improve the external validity of the program repair knowledge with the largest study ever.
Thu 26 AugDisplayed time zone: Athens change
12:00 - 13:00 | Testing—Program Repair 2Research Papers / Journal First +12h Chair(s): Saikat Chakraborty Columbia University | ||
12:00 10mPaper | VarFix: Balancing Edit Expressiveness and Search Effectiveness in Automated Program Repair Research Papers Chu-Pan Wong Carnegie Mellon University, Priscila Santiesteban Coe College, Christian Kästner Carnegie Mellon University, Claire Le Goues Carnegie Mellon University DOI | ||
12:10 10mPaper | Automated Patch Assessment for Program Repair at Scale Journal First He Ye KTH Royal Institute of Technology, Matias Martinez Université Polytechnique Hauts-de-France, Martin Monperrus KTH Royal Institute of Technology | ||
12:20 10mPaper | Restore: Retrospective Fault Localization Enhancing Automated Program Repair Journal First Tongtong Xu Department of Computing, The Hong Kong Polytechnic University, China; The State Key Laboratory for Novel Software Technology, Nanjing University, China, Liushan Chen The Hong Kong Polytechnic University, Yu Pei Hong Kong Polytechnic University, Tian Zhang Nanjing University, Minxue Pan Nanjing University, Carlo A. Furia Università della Svizzera italiana (USI) | ||
12:30 30mLive Q&A | Q&A (Testing—Program Repair 2) Research Papers |
Fri 27 AugDisplayed time zone: Athens change
00:00 - 01:00 | Testing—Program Repair 2Journal First / Research Papers Chair(s): Tien N. Nguyen University of Texas at Dallas | ||
00:00 10mPaper | VarFix: Balancing Edit Expressiveness and Search Effectiveness in Automated Program Repair Research Papers Chu-Pan Wong Carnegie Mellon University, Priscila Santiesteban Coe College, Christian Kästner Carnegie Mellon University, Claire Le Goues Carnegie Mellon University DOI | ||
00:10 10mPaper | Automated Patch Assessment for Program Repair at Scale Journal First He Ye KTH Royal Institute of Technology, Matias Martinez Université Polytechnique Hauts-de-France, Martin Monperrus KTH Royal Institute of Technology | ||
00:20 10mPaper | Restore: Retrospective Fault Localization Enhancing Automated Program Repair Journal First Tongtong Xu Department of Computing, The Hong Kong Polytechnic University, China; The State Key Laboratory for Novel Software Technology, Nanjing University, China, Liushan Chen The Hong Kong Polytechnic University, Yu Pei Hong Kong Polytechnic University, Tian Zhang Nanjing University, Minxue Pan Nanjing University, Carlo A. Furia Università della Svizzera italiana (USI) | ||
00:30 30mLive Q&A | Q&A (Testing—Program Repair 2) Research Papers |