Write a Blog >>
ESEC/FSE 2021
Mon 23 - Sat 28 August 2021 Athens, Greece

This program is tentative and subject to change.

Thu 26 Aug 2021 17:30 - 17:45 - Testing—Test Generation 2
Fri 27 Aug 2021 05:30 - 05:45 - Testing—Test Generation 2

There has been a rapidly increasing demand for developing highly configurable software systems, which urgently calls for effective testing methodology. In practice, t-wise coverage has been widely recognized as a useful metric to evaluate the quality of a test suite for testing highly configurable software systems, and achieving high t-wise coverage is important for ensuring test adequacy. However, state-of-the-art methods usually cost a fairly long time to generate large test suites for high pairwise coverage (i.e., 2-wise coverage), which would lead to ineffective and inefficient testing of highly configurable software systems. In this paper, we propose a novel local search based sampling approach dubbed LS-Sampling for achieving high t-wise coverage. Extensive experiments on a large number of public benchmarks, which are collected from real-world, highly configurable software systems, show that LS-Sampling achieves higher 2-wise and 3-wise coverage than the current state of the art. LS-Sampling is effective, since on average it achieves the 2-wise coverage of 99.64% and the 3-wise coverage of 97.87% through generating a small test suite consisting of only 100 test cases (90% smaller than the test suite generated by state-of-the-art methods). Furthermore, LS-Sampling is efficient, since it only requires an average execution time of less than 40 seconds to generate a test suite with high 2-wise and 3-wise coverage.

This program is tentative and subject to change.

Conference Day
Thu 26 Aug

Displayed time zone: Athens change

17:00 - 18:00
Testing—Test Generation 2Journal First / Research Papers / Demonstrations +12h
17:00
15m
Talk
CrossASR++: A Modular Differential Testing Framework for Automatic Speech Recognition
Demonstrations
Muhammad Hilmi AsyrofiSingapore Management University, Zhou YangSchool of Information Systems, Singapore Management University, David LoSingapore Management University
DOI Pre-print
17:15
15m
Talk
GLIB: Towards Automated Test Oracle for Graphically-Rich Applications
Research Papers
Ke ChenFuxi AI Lab in Netease, Yufei LiUniversity of Texas at Dallas, Yingfeng ChenFuxi AI Lab in Netease, Changjie FanFuxi AI Lab in Netease, Zhipeng HuFuxi AI Lab in Netease, Wei YangUniversity of Texas at Dallas
17:30
15m
Talk
LS-Sampling: An Effective Local Search Based Sampling Approach for Achieving High t-wise Coverage
Research Papers
Chuan LuoMicrosoft Research, China, Binqi SunMicrosoft Research, Bo QiaoMicrosoft Research, China, Junjie ChenTianjin University, Hongyu ZhangUniversity of Newcastle, Australia, Jinkun LinState Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, China, Qingwei LinMicrosoft Research, China, Dongmei ZhangMicrosoft Research
17:45
15m
Talk
Practical Constraint Solving for Generating System Test Data
Journal First
Ghanem SoltanaSnT, University of Luxembourg, Mehrdad SabetzadehUniversity of Ottawa, Lionel BriandUniversity of Ottawa, Canada / University of Luxembourg, Luxembourg

Conference Day
Fri 27 Aug

Displayed time zone: Athens change

05:00 - 06:00
Testing—Test Generation 2Research Papers / Demonstrations / Journal First
05:00
15m
Talk
CrossASR++: A Modular Differential Testing Framework for Automatic Speech Recognition
Demonstrations
Muhammad Hilmi AsyrofiSingapore Management University, Zhou YangSchool of Information Systems, Singapore Management University, David LoSingapore Management University
DOI Pre-print
05:15
15m
Talk
GLIB: Towards Automated Test Oracle for Graphically-Rich Applications
Research Papers
Ke ChenFuxi AI Lab in Netease, Yufei LiUniversity of Texas at Dallas, Yingfeng ChenFuxi AI Lab in Netease, Changjie FanFuxi AI Lab in Netease, Zhipeng HuFuxi AI Lab in Netease, Wei YangUniversity of Texas at Dallas
05:30
15m
Talk
LS-Sampling: An Effective Local Search Based Sampling Approach for Achieving High t-wise Coverage
Research Papers
Chuan LuoMicrosoft Research, China, Binqi SunMicrosoft Research, Bo QiaoMicrosoft Research, China, Junjie ChenTianjin University, Hongyu ZhangUniversity of Newcastle, Australia, Jinkun LinState Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, China, Qingwei LinMicrosoft Research, China, Dongmei ZhangMicrosoft Research
05:45
15m
Talk
Practical Constraint Solving for Generating System Test Data
Journal First
Ghanem SoltanaSnT, University of Luxembourg, Mehrdad SabetzadehUniversity of Ottawa, Lionel BriandUniversity of Ottawa, Canada / University of Luxembourg, Luxembourg