Fri 27 Aug 2021 07:00 - 07:10 - Human Aspects—Human Computer Interaction Chair(s): Bonita Sharif
We present a new technique for synthesizing dynamic, constraint-based visual layouts from examples.
%
Our technique tackles two major challenges of layout synthesis.
%
First, realistic layouts, especially on the web, often contain hundreds of elements,
so the synthesizer needs to \emph{scale} to layouts of this complexity.
%
Second, in common usage scenarios, examples contain \emph{noise},
so the synthesizer needs to be tolerant to imprecise inputs.
%
To address these challenges we propose a two-phase approach to synthesis,
where a \emph{local inference} phase rapidly generates a set of likely candidate constraints that satisfy the given examples,
and then a \emph{global inference} phase selects a subset of the candidates that generalizes to unseen inputs.
%
This separation of concerns helps our technique tackle the two challenges:
the local phase employs \emph{Bayesian inference} to handle noisy inputs,
while the global phase leverages the \emph{hierarchical} nature of complex layouts
to decompose the global inference problem into inference of independent sub-layouts.
We implemented this technique in a tool called \textsc{Mockdown}
and evaluated it on nine real-world web layouts,
as well as a series of widespread layout components % extracted from the web layouts.
and an existing dataset of 644 Android applications.
%
Our experiments show
that \textsc{Mockdown} is able to synthesize a highly accurate layout for the majority of benchmarks
from just three examples
(two for Android layouts),
and that it scales to layouts with over 600 elements,
about 30x more than has been reported in prior work on layout synthesis.
Thu 26 AugDisplayed time zone: Athens change
19:00 - 20:00 | Human Aspects—Human Computer InteractionDemonstrations / Research Papers / Journal First +12h Chair(s): Kelly Lyons University of Toronto, Alexander Serebrenik Eindhoven University of Technology | ||
19:00 10mPaper | Synthesis of Web Layouts from Examples Research Papers Dylan Lukes University of California at San Diego, John Sarracino Cornell University, Cora Coleman University of California at San Diego, Hila Peleg Technion, Sorin Lerner University of California at San Diego, Nadia Polikarpova University of California at San Diego DOI | ||
19:10 5mPaper | Combined Intuition and Rationality Increases Software Feature Novelty for Female Software Designers Journal First Carianne Pretorius Eindhoven University of Technology, Maryam Razavian Eindhoven University of Technology, Katrin Eling Eindhoven University of Technology, Fred Langerak Eindhoven University of Technology | ||
19:15 5mPaper | BiasRV: Uncovering Biased Sentiment Predictions at Runtime Demonstrations Zhou Yang Singapore Management University, Muhammad Hilmi Asyrofi Singapore Management University, David Lo Singapore Management University DOI Media Attached | ||
19:20 5mPaper | OwlEyes-Online: A Fully Automated Platform for Detecting and Localizing UI Display Issues Demonstrations Yuhui Su Institute of Software at Chinese Academy of Sciences, Zhe Liu Institute of Software at Chinese Academy of Sciences, Chunyang Chen Monash University, Junjie Wang Institute of Software at Chinese Academy of Sciences, Qing Wang Institute of Software at Chinese Academy of Sciences DOI Authorizer link Pre-print Media Attached | ||
19:25 5mPaper | Frontmatter: Mining Android User Interfaces at Scale Demonstrations Konstantin Kuznetsov CISPA, Chen Fu Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Song Gao Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, David N. Jansen Institute of Software at Chinese Academy of Sciences; Institute of Intelligent Software, Lijun Zhang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences; Institute of Intelligent Software, Andreas Zeller CISPA DOI Media Attached | ||
19:30 30mLive Q&A | Q&A (Human Aspects—Human Computer Interaction) Research Papers |
Fri 27 AugDisplayed time zone: Athens change
07:00 - 08:00 | Human Aspects—Human Computer InteractionDemonstrations / Journal First / Research Papers Chair(s): Bonita Sharif University of Nebraska-Lincoln, USA | ||
07:00 10mPaper | Synthesis of Web Layouts from Examples Research Papers Dylan Lukes University of California at San Diego, John Sarracino Cornell University, Cora Coleman University of California at San Diego, Hila Peleg Technion, Sorin Lerner University of California at San Diego, Nadia Polikarpova University of California at San Diego DOI | ||
07:10 5mPaper | Combined Intuition and Rationality Increases Software Feature Novelty for Female Software Designers Journal First Carianne Pretorius Eindhoven University of Technology, Maryam Razavian Eindhoven University of Technology, Katrin Eling Eindhoven University of Technology, Fred Langerak Eindhoven University of Technology | ||
07:15 5mPaper | BiasRV: Uncovering Biased Sentiment Predictions at Runtime Demonstrations Zhou Yang Singapore Management University, Muhammad Hilmi Asyrofi Singapore Management University, David Lo Singapore Management University DOI Media Attached | ||
07:20 5mPaper | OwlEyes-Online: A Fully Automated Platform for Detecting and Localizing UI Display Issues Demonstrations Yuhui Su Institute of Software at Chinese Academy of Sciences, Zhe Liu Institute of Software at Chinese Academy of Sciences, Chunyang Chen Monash University, Junjie Wang Institute of Software at Chinese Academy of Sciences, Qing Wang Institute of Software at Chinese Academy of Sciences DOI Authorizer link Pre-print Media Attached | ||
07:25 5mPaper | Frontmatter: Mining Android User Interfaces at Scale Demonstrations Konstantin Kuznetsov CISPA, Chen Fu Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Song Gao Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, David N. Jansen Institute of Software at Chinese Academy of Sciences; Institute of Intelligent Software, Lijun Zhang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences; Institute of Intelligent Software, Andreas Zeller CISPA DOI Media Attached | ||
07:30 30mLive Q&A | Q&A (Human Aspects—Human Computer Interaction) Research Papers |