FuzzBench: An Open Fuzzer Benchmarking Platform and Service
Thu 26 Aug 2021 20:20 - 20:30 - Testing—Fuzzing Chair(s): Felipe Fronchetti
Fuzzing is a key tool used to reduce bugs in production software.
At Google, fuzzing has uncovered tens of thousands of bugs.
Fuzzing is also a popular subject of academic research.
In $2020$ alone, over $120$ papers were published on the topic of improving, developing, and evaluating fuzzers and fuzzing techniques.
Yet, proper evaluation of fuzzing techniques remains elusive.
The community has struggled to converge on methodology and standard tools for fuzzer evaluation.
To address this problem, we introduce FuzzBench as an open-source turnkey platform and free service for evaluating fuzzers.
It aims to be easy to use, fast, reliable, and provides reproducible experiments.
Since its release in March $2020$, FuzzBench has been widely used both in industry and academia, carrying out more than $150$ experiments for external users.
It has been used by several published and in-the-work papers from academic groups, and has had real impact on the most widely used fuzzing tools in industry.
The presented case studies suggest that FuzzBench is on its way to becoming a standard fuzzer benchmarking platform.
Thu 26 AugDisplayed time zone: Athens change
08:00 - 09:00 | |||
08:00 10mPaper | Estimating Residual Risk in Greybox Fuzzing Research Papers Link to publication DOI Pre-print | ||
08:10 10mPaper | HeteroFuzz: Fuzz Testing to Detect Platform Dependent Divergence for Heterogeneous Applications Research Papers Qian Zhang University of California at Los Angeles, Jiyuan Wang University of California at Los Angeles, Miryung Kim University of California at Los Angeles DOI | ||
08:20 10mPaper | FuzzBench: An Open Fuzzer Benchmarking Platform and Service Industry Papers Jonathan Metzman Google, Laszlo Szekeres Google, Laurent Simon Google, Read Sprabery Google, Abhishek Arya Google DOI | ||
08:30 30mLive Q&A | Q&A (Testing—Fuzzing) Research Papers |
20:00 - 21:00 | Testing—FuzzingResearch Papers / Industry Papers Chair(s): Felipe Fronchetti University of São Paulo, Brazil | ||
20:00 10mPaper | Estimating Residual Risk in Greybox Fuzzing Research Papers Link to publication DOI Pre-print | ||
20:10 10mPaper | HeteroFuzz: Fuzz Testing to Detect Platform Dependent Divergence for Heterogeneous Applications Research Papers Qian Zhang University of California at Los Angeles, Jiyuan Wang University of California at Los Angeles, Miryung Kim University of California at Los Angeles DOI | ||
20:20 10mPaper | FuzzBench: An Open Fuzzer Benchmarking Platform and Service Industry Papers Jonathan Metzman Google, Laszlo Szekeres Google, Laurent Simon Google, Read Sprabery Google, Abhishek Arya Google DOI | ||
20:30 30mLive Q&A | Q&A (Testing—Fuzzing) Research Papers |