Practical Constraint Solving for Generating System Test Data
Fri 27 Aug 2021 05:25 - 05:30 - Testing—Test Generation 2 Chair(s): Shiva Nejati
The ability to generate test data is often a necessary prerequisite for automated software testing. For the generated data to be fit for its intended purpose, the data usually has to satisfy various logical constraints. When testing is performed at a system level, these constraints tend to be complex and are typically captured in expressive formalisms based on first-order logic. Motivated by improving the feasibility and scalability of data generation for system testing, we present a novel approach, whereby we employ a combination of metaheuristic search and Satisfiability Modulo Theories (SMT) for constraint solving. Our approach delegates constraint solving tasks to metaheuristic search and SMT in such a way as to take advantage of the complementary strengths of the two techniques. We ground our work on test data models specified in UML, with OCL used as the constraint language. We present tool support and an evaluation of our approach over three industrial case studies. The results indicate that, for complex system test data generation problems, our approach presents substantial benefits over the state of the art in terms of applicability and scalability.
Thu 26 AugDisplayed time zone: Athens change
17:00 - 18:00 | Testing—Test Generation 2Journal First / Research Papers / Demonstrations +12h Chair(s): Gunel Jahangirova USI Lugano, Michael Pradel University of Stuttgart | ||
17:00 10mPaper | LS-Sampling: An Effective Local Search Based Sampling Approach for Achieving High t-wise Coverage Research Papers Chuan Luo Microsoft Research, Binqi Sun Microsoft Research, Bo Qiao Microsoft Research, Junjie Chen Tianjin University, Hongyu Zhang University of Newcastle, Jinkun Lin Institute of Software at Chinese Academy of Sciences, Qingwei Lin Microsoft Research, Dongmei Zhang Microsoft Research DOI | ||
17:10 10mPaper | GLIB: Towards Automated Test Oracle for Graphically-Rich Applications Research Papers Ke Chen Fuxi AI Lab of Netease, Yufei Li University of Texas at Dallas, Yingfeng Chen Fuxi AI Lab of Netease, Changjie Fan Netease, Zhipeng Hu Netease, Wei Yang University of Texas at Dallas DOI | ||
17:20 5mPaper | CrossASR++: A Modular Differential Testing Framework for Automatic Speech Recognition Demonstrations Muhammad Hilmi Asyrofi Singapore Management University, Zhou Yang Singapore Management University, David Lo Singapore Management University DOI Pre-print Media Attached | ||
17:25 5mPaper | Practical Constraint Solving for Generating System Test Data Journal First Ghanem Soltana SnT, University of Luxembourg, Mehrdad Sabetzadeh University of Ottawa, Lionel Briand University of Ottawa, Canada / University of Luxembourg, Luxembourg | ||
17:30 30mLive Q&A | Q&A (Testing—Test Generation 2) Research Papers |
Fri 27 AugDisplayed time zone: Athens change
05:00 - 06:00 | Testing—Test Generation 2Research Papers / Demonstrations / Journal First Chair(s): Shiva Nejati University of Ottawa | ||
05:00 10mPaper | LS-Sampling: An Effective Local Search Based Sampling Approach for Achieving High t-wise Coverage Research Papers Chuan Luo Microsoft Research, Binqi Sun Microsoft Research, Bo Qiao Microsoft Research, Junjie Chen Tianjin University, Hongyu Zhang University of Newcastle, Jinkun Lin Institute of Software at Chinese Academy of Sciences, Qingwei Lin Microsoft Research, Dongmei Zhang Microsoft Research DOI | ||
05:10 10mPaper | GLIB: Towards Automated Test Oracle for Graphically-Rich Applications Research Papers Ke Chen Fuxi AI Lab of Netease, Yufei Li University of Texas at Dallas, Yingfeng Chen Fuxi AI Lab of Netease, Changjie Fan Netease, Zhipeng Hu Netease, Wei Yang University of Texas at Dallas DOI | ||
05:20 5mPaper | CrossASR++: A Modular Differential Testing Framework for Automatic Speech Recognition Demonstrations Muhammad Hilmi Asyrofi Singapore Management University, Zhou Yang Singapore Management University, David Lo Singapore Management University DOI Pre-print Media Attached | ||
05:25 5mPaper | Practical Constraint Solving for Generating System Test Data Journal First Ghanem Soltana SnT, University of Luxembourg, Mehrdad Sabetzadeh University of Ottawa, Lionel Briand University of Ottawa, Canada / University of Luxembourg, Luxembourg | ||
05:30 30mLive Q&A | Q&A (Testing—Test Generation 2) Research Papers |