Write a Blog >>
ESEC/FSE 2021
Thu 19 - Sat 28 August 2021 Clowdr Platform
Wed 25 Aug 2021 17:00 - 17:10 - Testing—Failures and Fault Localization Chair(s): Shaukat Ali
Thu 26 Aug 2021 05:00 - 05:10 - Testing—Failures and Fault Localization Chair(s): Massimiliano Di Penta

Software developers insert logging statements in their source code to collect important runtime information of software systems. In practice, logging appropriately is a challenge for developers. Prior studies aimed to improve logging by proactively inserting logging statements in certain code snippets or by learning where to log from existing logging code. However, there exists no work that systematically studies developers’ logging considerations, i.e., the benefits and costs of logging from developers’ perspectives. Without understanding developers’ logging considerations, automated approaches for logging decisions are based primarily on researchers’ intuition which may not be convincing to developers.

In order to fill the gap between developers’ logging considerations and researchers’ intuition, we performed a qualitative study that combines a survey of 66 developers and a case study of 223 logging-related issue reports. The findings of our qualitative study draw a comprehensive picture of the benefits and costs of logging from developers’ perspectives. We observe that developers consider a wide range of logging benefits and costs, while most of the uncovered benefits and costs have never been observed nor discussed in prior work. We also observe that developers use ad hoc strategies to balance the benefits and costs of logging. Developers need to be fully aware of the benefits and costs of logging, in order to better benefit from logging (e.g., leveraging logging to enable users to solve problems by themselves) and avoid unnecessary negative impact (e.g., exposing users’ sensitive information). Future research needs to consider such a wide range of logging benefits and costs when developing automated logging strategies. Our findings also inspire opportunities for researchers and logging library providers to help developers balance the benefits and costs of logging, for example, to support different log levels for different parts of a logging statement, or to help developers estimate and reduce the negative impact of logging statements.

Wed 25 Aug

Displayed time zone: Athens change

17:00 - 18:00
Testing—Failures and Fault LocalizationDemonstrations / Research Papers / Journal First / Ideas, Visions and Reflections +12h
Chair(s): Shaukat Ali Simula Research Lab
17:00
10m
Paper
A Qualitative Study of the Benefits and Costs of Logging from Developers' Perspectives: A Journal First Presentation Proposal
Journal First
Heng Li Polytechnique Montréal, Weiyi Shang Concordia University, Bram Adams Queens University, Mohammed Sayagh ETS Montreal, University of Quebec, Ahmed E. Hassan Queen's University
17:10
5m
Paper
Just-In-Time Defect Identification and Localization: A Two-Phase Framework
Journal First
Meng Yan Chongqing University, Xin Xia Huawei Technologies, Yuanrui Fan Zhejiang University, David Lo Singapore Management University, Ahmed E. Hassan Queen's University, Shanping Li Zhejiang University
17:15
5m
Paper
New Visions on Metamorphic Testing after a Quarter of a Century of Inception
Ideas, Visions and Reflections
Tsong Yueh Chen Swinburne University of Technology, T. H. Tse University of Hong Kong
DOI
17:20
5m
Paper
AlloyFL: A Fault Localization Framework for Alloy
Demonstrations
Tanvir Ahmed Khan University of Texas at Arlington, Allison Sullivan University of Texas at Arlington, Kaiyuan Wang Google
DOI Media Attached
17:25
5m
Paper
BF-Detector: An Automated Tool for CI Build Failure Detection
Demonstrations
Islem Saidani ETS, Ali Ouni ETS, Moataz Chouchen ETS, Mohamed Wiem Mkaouer Rochester Institute of Technology
DOI
17:30
30m
Live Q&A
Q&A (Testing—Failures and Fault Localization)
Research Papers

Thu 26 Aug

Displayed time zone: Athens change

05:00 - 06:00
Testing—Failures and Fault LocalizationDemonstrations / Ideas, Visions and Reflections / Journal First / Research Papers
Chair(s): Massimiliano Di Penta University of Sannio
05:00
10m
Paper
A Qualitative Study of the Benefits and Costs of Logging from Developers' Perspectives: A Journal First Presentation Proposal
Journal First
Heng Li Polytechnique Montréal, Weiyi Shang Concordia University, Bram Adams Queens University, Mohammed Sayagh ETS Montreal, University of Quebec, Ahmed E. Hassan Queen's University
05:10
5m
Paper
Just-In-Time Defect Identification and Localization: A Two-Phase Framework
Journal First
Meng Yan Chongqing University, Xin Xia Huawei Technologies, Yuanrui Fan Zhejiang University, David Lo Singapore Management University, Ahmed E. Hassan Queen's University, Shanping Li Zhejiang University
05:15
5m
Paper
New Visions on Metamorphic Testing after a Quarter of a Century of Inception
Ideas, Visions and Reflections
Tsong Yueh Chen Swinburne University of Technology, T. H. Tse University of Hong Kong
DOI
05:20
5m
Paper
AlloyFL: A Fault Localization Framework for Alloy
Demonstrations
Tanvir Ahmed Khan University of Texas at Arlington, Allison Sullivan University of Texas at Arlington, Kaiyuan Wang Google
DOI Media Attached
05:25
5m
Paper
BF-Detector: An Automated Tool for CI Build Failure Detection
Demonstrations
Islem Saidani ETS, Ali Ouni ETS, Moataz Chouchen ETS, Mohamed Wiem Mkaouer Rochester Institute of Technology
DOI
05:30
30m
Live Q&A
Q&A (Testing—Failures and Fault Localization)
Research Papers