Monotone Precision and Recall Measures for Comparing Executions and Specifications of Dynamic Systems
Wed 25 Aug 2021 21:20 - 21:30 - Analysis—Dynamic Analysis Chair(s): Kexin Pei
The behavioural comparison of systems is an important concern of software engineering research. For example, the areas of specification discovery and specification mining are concerned with measuring the consistency between a collection of execution traces and a program specification. This problem is also tackled in process mining with the help of measures that describe the quality of a process specification automatically discovered from execution logs. Though various measures have been proposed, it was recently demonstrated that they neither fulfil essential properties, such as monotonicity, nor can they handle infinite behaviour. In this paper, we address this research problem by introducing a new framework for the definition of behavioural quotients. We proof that corresponding quotients guarantee desired properties that existing measures have failed to support. We demonstrate the application of the quotients for capturing precision and recall measures between a collection of recorded executions and a system specification. We use a prototypical implementation of these measures to contrast their monotonic assessment with measures that have been defined in prior research.
Wed 25 AugDisplayed time zone: Athens change
09:00 - 10:00 | Analysis—Dynamic AnalysisResearch Papers / Journal First +12h Chair(s): Dimitris Mitropoulos University of Athens, Valerio Terragni University of Auckland | ||
09:00 10mPaper | Efficient Module-Level Dynamic Analysis for Dynamic Languages with Module RecontextualizationDistinguished Paper Award Research Papers Nikos Vasilakis Massachusetts Institute of Technology, Grigoris Ntousakis TU Crete, Veit Heller n.n., Martin C. Rinard Massachusetts Institute of Technology DOI | ||
09:10 10mPaper | Seads: Scalable and Cost-Effective Dynamic Dependence Analysis of Distributed Systems via Reinforcement Learning Journal First Xiaoqin Fu Washington State University, Haipeng Cai Washington State University, USA, Wen Li , Li Li Monash University | ||
09:20 10mPaper | Monotone Precision and Recall Measures for Comparing Executions and Specifications of Dynamic Systems Journal First Artem Polyvyanyy The University of Melbourne, Andreas Solti Vienna University of Economics and Business, Matthias Weidlich Humboldt-Universtität zu Berlin, Claudio Di Ciccio Department of Computer Science, Sapienza University of Rome, Jan Mendling Vienna University of Economics and Business | ||
09:30 30mLive Q&A | Q&A (Analysis—Dynamic Analysis) Research Papers |