Write a Blog >>
ESEC/FSE 2021
Thu 19 - Sat 28 August 2021 Clowdr Platform

To facilitate the rapid release cadence of modern software (on the order of weeks, days, or even hours), software development organizations invest in practices like Continuous Integration (CI), where each change submitted by developers is built (e.g., compiled, tested, linted) to detect problematic changes early. A fast and efficient build process is crucial to provide timely CI feedback to developers. If CI feedback is too slow, developers may switch contexts to other tasks, which is known to be a costly operation for knowledge workers. Thus, minimizing the build execution time for CI services is an important task.

While recent work has made several important advances in the acceleration of CI builds, optimizations often depend upon explicitly defined build dependency graphs (e.g., make, Gradle, CloudBuild, Bazel). These hand-maintained graphs may be (a) underspecified, leading to incorrect build behaviour; or (b) overspecified, leading to missed acceleration opportunities. In this paper, we propose Kotinos—a language-agnostic approach to infer data from which build acceleration decisions can be made without relying upon build specifications. After inferring this data, our approach accelerates CI builds by caching the build environment and skipping unaffected build steps. Kotinos is at the core of a commercial CI service with a growing customer base. To evaluate Kotinos, we mine 14,364 historical CI build records spanning three proprietary and seven open-source software projects. We find that: (1) at least 87.9% of the builds activate at least one Kotinos acceleration; and (2) 74% of accelerated builds achieve a speed-up of two-fold with respect to their non-accelerated counterparts. Moreover, (3) the benefits of Kotinos can also be replicated in open source software systems; and (4) Kotinos imposes minimal resource overhead (i.e., < 1% median CPU usage, 2 MB – 2.2 GB median memory usage, and 0.4 GB – 5.2 GB median storage overhead) and does not compromise build outcomes. Our results suggest that migration to Kotinos yields substantial benefits with minimal investment of effort (e.g., no migration of build systems is necessary).

Wed 25 Aug

Displayed time zone: Athens change

11:00 - 12:00
Analytics & Software Evolution—Continuous Integration and DeliveryResearch Papers / Journal First +12h
Chair(s): Fiorella Zampetti University of Sannio, Italy
11:00
10m
Paper
Accelerating Continuous Integration by Caching Environments and Inferring Dependencies
Journal First
Keheliya Gallaba McGill University, John Ewart YourBase Inc., Yves Junqueira YourBase Inc., Shane McIntosh McGill University
11:10
10m
Paper
Predicting Node Failures in an Ultra-large-scale Cloud Computing Platform: an AIOps Solution: A Journal First Presentation Proposal
Journal First
Yangguang Li York University, Zhen Ming (Jack) Jiang York University , Heng Li Polytechnique Montréal, Ahmed E. Hassan Queen's University, Cheng He Alibaba Group, Ruirui Huang Alibaba Group, China, Zhengda Zeng Alibaba Group, Mian Wang Alibaba Group, PIN AN CHEN Alibaba
11:20
10m
Paper
Automating Serverless Deployments for DevOps OrganizationsArtifacts AvailableArtifacts Reusable
Research Papers
Daniel Sokolowski TU Darmstadt, Pascal Weisenburger TU Darmstadt, Guido Salvaneschi University of St. Gallen
DOI Pre-print
11:30
30m
Live Q&A
Q&A (Analytics & Software Evolution—Continuous Integration and Delivery)
Research Papers

23:00 - 00:00
Analytics & Software Evolution—Continuous Integration and DeliveryJournal First / Research Papers
Chair(s): Gustavo Pinto Federal University of Pará (UFPA) and Zup Innovation
23:00
10m
Paper
Accelerating Continuous Integration by Caching Environments and Inferring Dependencies
Journal First
Keheliya Gallaba McGill University, John Ewart YourBase Inc., Yves Junqueira YourBase Inc., Shane McIntosh McGill University
23:10
10m
Paper
Predicting Node Failures in an Ultra-large-scale Cloud Computing Platform: an AIOps Solution: A Journal First Presentation Proposal
Journal First
Yangguang Li York University, Zhen Ming (Jack) Jiang York University , Heng Li Polytechnique Montréal, Ahmed E. Hassan Queen's University, Cheng He Alibaba Group, Ruirui Huang Alibaba Group, China, Zhengda Zeng Alibaba Group, Mian Wang Alibaba Group, PIN AN CHEN Alibaba
23:20
10m
Paper
Automating Serverless Deployments for DevOps OrganizationsArtifacts AvailableArtifacts Reusable
Research Papers
Daniel Sokolowski TU Darmstadt, Pascal Weisenburger TU Darmstadt, Guido Salvaneschi University of St. Gallen
DOI Pre-print
23:30
30m
Live Q&A
Q&A (Analytics & Software Evolution—Continuous Integration and Delivery)
Research Papers