american fuzzy lop (fuzzer)
american fuzzy lop is a free software fuzzer that employs genetic algorithms in order to efficiently increase code coverage of the test cases. So far it helped in detection of significant software bugs in dozens of major free software projects, including X.Org Server,[2] PHP,[3] OpenSSL,[4][5] pngcrush, bash,[6] Firefox,[7] BIND,[8][9] Qt,[10] and SQLite.[11]
American fuzzy lop's afl-fuzz running on a test program | |
Developer(s) | Michał Zalewski |
---|---|
Initial release | 12 November 2013 |
Stable release | 2.56b
/ 26 September 2019[1] |
Repository | |
Written in | C, assembly |
Operating system | Cross-platform |
Type | Fuzzer |
License | Apache License 2.0 |
Website | lcamtuf |
american fuzzy lop's source code is published on GitHub. Its name is a reference to a breed of rabbit, the American Fuzzy Lop.
Typical usage
The program requires the user to provide a sample command that runs the tested application and at least one small example input file. For example, in case of an audio player, american fuzzy lop can be instructed to open a short sound file with it. Then, the fuzzer attempts to actually execute the specified command and if that succeeds, it tries to reduce the input file to the smallest one that triggers the same behavior.
After this initial phase, AFL begins the actual process of fuzzing by applying various modifications to the input file. When the tested program crashes or hangs, this might suggest the discovery of a new bug, possibly a security vulnerability. In this case, the modified input file is saved for further user inspection.
In order to maximize the fuzzing performance, american fuzzy lop expects the tested program to be compiled with the aid of a utility program that instruments the code with helper functions which track control flow. This allows the fuzzer to detect when the target's behavior changes in response to the input. In cases when this is not possible, black-box testing is supported as well.
Features
Fuzzing engine
The fuzzing engine of american fuzzy lop uses several algorithms whose goal is to trigger unexpected behavior, including bit flips or replacing bytes of input file with various integers that can trigger edge cases.[13] Apart from that, it can generate test cases based on sample keywords, which helps during fuzzing of programs that employed text-based grammar, such as SQLite.[14] Generated test cases that exercise different parts of the program's code can later be used as input for more specialized diagnostic programs. While performing the fuzzing, a hang can be detected when the process does not exit within the specified timeout and crash is assumed when a signal handler kills the process.
The fuzzed input can be fed to the tested program either via standard input or as an input file specified in the process command line. Fuzzing networked programs is currently not directly supported, although in some cases there are feasible solutions to this problem.[15]
Performance features
One of the challenges american fuzzy lop had to solve involved an efficient spawning of hundreds of processes per second. Apart from the original engine that spawned every process from scratch, american fuzzy lop offers the default engine that relies heavily on fork
system call.[16] This can further be sped up by leveraging LLVM deferred forkserver mode or the similar persistent mode, but this comes at the cost of having to modify the tested program.[17] Also, american fuzzy lop supports fuzzing the same program over the network.
User interface
american fuzzy lop features a colorful command line interface that displays real-time statistics about the fuzzing process. Various settings may be triggered by either command line options or environment variables. Apart from that, programs may read runtime statistics from files in a machine-readable format.
Utility programs
In addition to afl-fuzz
and tools that can be used for binary instrumentation, american fuzzy lop features utility programs meant for monitoring of the fuzzing process. Apart from that, there is afl-cmin
and afl-tmin
, which can be used for test case and test corpus minimization. This can be useful when the test cases generated by afl-fuzz
would be used by other fuzzers.
References
- "Releases - google/AFL". Retrieved 7 October 2019 – via GitHub.
- "Advisory-2015-03-17". x.org.
- "NVD - Detail". nist.gov.
- "NVD - Detail". nist.gov.
- "NVD - Detail". nist.gov.
- "CVE - CVE-2014-6278". mitre.org.
- "CVE - CVE-2014-8637". mitre.org.
- "How to fuzz a server with American Fuzzy Lop". Fastly.
- "CVE - CVE-2015-5477". mitre.org.
- "[Announce] Qt Project Security Advisory - Multiple Vulnerabilities in Qt Image Format Handling". qt-project.org.
- "How SQLite Is Tested # 4.1.1. SQL Fuzz Using The American Fuzzy Lop Fuzzer". sqlite.org.
- Zalewski, Michał (2015-02-27). "Logo for afl-fuzz". afl-users | Google Groups. Retrieved 2019-07-25.
- "Binary fuzzing strategies: what works, what doesn't". lcamtuf.blogspot.com.
- "Finding bugs in SQLite, the easy way". lcamtuf.blogspot.com.
- Technion. "Fuzzing nginx - Hunting vulnerabilities with afl-fuzz". lolware.net.
- "Fuzzing random programs without execve()". lcamtuf.blogspot.com.
- "Lesser-known features of afl-fuzz". lcamtuf's blog. 20 May 2015. Retrieved 27 February 2020.
Further reading
- S. K. Cha, M. Woo, D. Brumley, "Program-Adaptive Mutational Fuzzing," in Proceedings of the 36th IEEE Symposium on Security and Privacy, 2015. (to appear)
- Multi-System and Internet Security Cookbook, Hors-Serie No. 11 "Outils de sécurité", p. 36, "American Fuzzy Lop", Kevin Denis, June 2015.
- "Fuzz and strings (lwn.net)"
- "Fuzzing (on) FreeBSD - (Mostly) automated bug discovery with security/afl" - a presentation at FOSDEM
- "Testing with two failure seeking missiles: fuzzing and property based testing" - a presentation at EuroPython 2015.
- "Stagefright: Scary Code in the Heart of Android" a presentation at Black Hat Briefings
- "The Fuzzing Project"
- "Grammatical Inference and Language Frameworks for LANGSEC"
- "Fuzzing Code with AFL", Peter Gutmann, ;login, Vol. 41, No. 2, Summer 2016,