Write a Blog >>
ESEC/FSE 2021
Thu 19 - Sat 28 August 2021 Clowdr Platform
Thu 26 Aug 2021 19:00 - 19:10 - Human Aspects—Human Computer Interaction Chair(s): Kelly Lyons, Alexander Serebrenik
Fri 27 Aug 2021 07:00 - 07:10 - Human Aspects—Human Computer Interaction Chair(s): Bonita Sharif

We present a new technique for synthesizing dynamic, constraint-based visual layouts from examples.
%
Our technique tackles two major challenges of layout synthesis.
%
First, realistic layouts, especially on the web, often contain hundreds of elements,
so the synthesizer needs to \emph{scale} to layouts of this complexity.
%
Second, in common usage scenarios, examples contain \emph{noise},
so the synthesizer needs to be tolerant to imprecise inputs.
%
To address these challenges we propose a two-phase approach to synthesis,
where a \emph{local inference} phase rapidly generates a set of likely candidate constraints that satisfy the given examples,
and then a \emph{global inference} phase selects a subset of the candidates that generalizes to unseen inputs.
%
This separation of concerns helps our technique tackle the two challenges:
the local phase employs \emph{Bayesian inference} to handle noisy inputs,
while the global phase leverages the \emph{hierarchical} nature of complex layouts
to decompose the global inference problem into inference of independent sub-layouts.

We implemented this technique in a tool called \textsc{Mockdown}
and evaluated it on nine real-world web layouts,
as well as a series of widespread layout components % extracted from the web layouts.
and an existing dataset of 644 Android applications.
%
Our experiments show
that \textsc{Mockdown} is able to synthesize a highly accurate layout for the majority of benchmarks
from just three examples
(two for Android layouts),
and that it scales to layouts with over 600 elements,
about 30x more than has been reported in prior work on layout synthesis.

Thu 26 Aug

Displayed time zone: Athens change

19:00 - 20:00
Human Aspects—Human Computer InteractionDemonstrations / Research Papers / Journal First +12h
Chair(s): Kelly Lyons University of Toronto, Alexander Serebrenik Eindhoven University of Technology
19:00
10m
Paper
Synthesis of Web Layouts from ExamplesArtifacts AvailableArtifacts Reusable
Research Papers
Dylan Lukes University of California at San Diego, John Sarracino Cornell University, Cora Coleman University of California at San Diego, Hila Peleg Technion, Sorin Lerner University of California at San Diego, Nadia Polikarpova University of California at San Diego
DOI
19:10
5m
Paper
Combined Intuition and Rationality Increases Software Feature Novelty for Female Software Designers
Journal First
Carianne Pretorius Eindhoven University of Technology, Maryam Razavian Eindhoven University of Technology, Katrin Eling Eindhoven University of Technology, Fred Langerak Eindhoven University of Technology
19:15
5m
Paper
BiasRV: Uncovering Biased Sentiment Predictions at Runtime
Demonstrations
Zhou Yang Singapore Management University, Muhammad Hilmi Asyrofi Singapore Management University, David Lo Singapore Management University
DOI Media Attached
19:20
5m
Paper
OwlEyes-Online: A Fully Automated Platform for Detecting and Localizing UI Display Issues
Demonstrations
Yuhui Su Institute of Software at Chinese Academy of Sciences, Zhe Liu Institute of Software at Chinese Academy of Sciences, Chunyang Chen Monash University, Junjie Wang Institute of Software at Chinese Academy of Sciences, Qing Wang Institute of Software at Chinese Academy of Sciences
DOI Authorizer link Pre-print Media Attached
19:25
5m
Paper
Frontmatter: Mining Android User Interfaces at ScaleArtifacts Available
Demonstrations
Konstantin Kuznetsov CISPA, Chen Fu Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Song Gao Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, David N. Jansen Institute of Software at Chinese Academy of Sciences; Institute of Intelligent Software, Lijun Zhang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences; Institute of Intelligent Software, Andreas Zeller CISPA
DOI Media Attached
19:30
30m
Live Q&A
Q&A (Human Aspects—Human Computer Interaction)
Research Papers

Fri 27 Aug

Displayed time zone: Athens change

07:00 - 08:00
Human Aspects—Human Computer InteractionDemonstrations / Journal First / Research Papers
Chair(s): Bonita Sharif University of Nebraska-Lincoln, USA
07:00
10m
Paper
Synthesis of Web Layouts from ExamplesArtifacts AvailableArtifacts Reusable
Research Papers
Dylan Lukes University of California at San Diego, John Sarracino Cornell University, Cora Coleman University of California at San Diego, Hila Peleg Technion, Sorin Lerner University of California at San Diego, Nadia Polikarpova University of California at San Diego
DOI
07:10
5m
Paper
Combined Intuition and Rationality Increases Software Feature Novelty for Female Software Designers
Journal First
Carianne Pretorius Eindhoven University of Technology, Maryam Razavian Eindhoven University of Technology, Katrin Eling Eindhoven University of Technology, Fred Langerak Eindhoven University of Technology
07:15
5m
Paper
BiasRV: Uncovering Biased Sentiment Predictions at Runtime
Demonstrations
Zhou Yang Singapore Management University, Muhammad Hilmi Asyrofi Singapore Management University, David Lo Singapore Management University
DOI Media Attached
07:20
5m
Paper
OwlEyes-Online: A Fully Automated Platform for Detecting and Localizing UI Display Issues
Demonstrations
Yuhui Su Institute of Software at Chinese Academy of Sciences, Zhe Liu Institute of Software at Chinese Academy of Sciences, Chunyang Chen Monash University, Junjie Wang Institute of Software at Chinese Academy of Sciences, Qing Wang Institute of Software at Chinese Academy of Sciences
DOI Authorizer link Pre-print Media Attached
07:25
5m
Paper
Frontmatter: Mining Android User Interfaces at ScaleArtifacts Available
Demonstrations
Konstantin Kuznetsov CISPA, Chen Fu Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Song Gao Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, David N. Jansen Institute of Software at Chinese Academy of Sciences; Institute of Intelligent Software, Lijun Zhang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences; Institute of Intelligent Software, Andreas Zeller CISPA
DOI Media Attached
07:30
30m
Live Q&A
Q&A (Human Aspects—Human Computer Interaction)
Research Papers