Fuzz introspector
For issues and ideas: https://github.com/ossf/fuzz-introspector/issues

Project functions overview

The following table shows data about each function in the project. The functions included in this table correspond to all functions that exist in the executables of the fuzzers. As such, there may be functions that are from third-party libraries.

For further technical details on the meaning of columns in the below table, please see the Glossary .

Func name Functions filename Args Function call depth Reached by Fuzzers Runtime reached by Fuzzers Combined reached by Fuzzers Fuzzers runtime hit Func lines hit % I Count BB Count Cyclomatic complexity Functions reached Reached by functions Accumulated cyclomatic complexity Undiscovered complexity

Fuzzer details

Fuzzer: sanitize_fuzzer

Call tree

The calltree shows the control flow of the fuzzer. This is overlaid with coverage information to display how much of the potential code a fuzzer can reach is in fact covered at runtime. In the following there is a link to a detailed calltree visualisation as well as a bitmap showing a high-level view of the calltree. For further information about these topics please see the glossary for full calltree and calltree overview

Call tree overview bitmap:

The distribution of callsites in terms of coloring is
Color Runtime hitcount Callsite count Percentage
red 0 574 51.7%
gold [1:9] 0 0.0%
yellow [10:29] 0 0.0%
greenyellow [30:49] 0 0.0%
lawngreen 50+ 535 48.2%
All colors 1109 100

Fuzz blockers

The following nodes represent call sites where fuzz blockers occur.

Amount of callsites blocked Calltree index Parent function Callsite Largest blocked function
77 977 bleach.sanitizer.BleachSanitizerFilter.sanitize_stream call site: 00977 bleach._vendor.html5lib.filters.optionaltags.Filter.__iter__
71 857 bleach.html5lib_shim.match_entity call site: 00857 bleach._vendor.html5lib.filters.whitespace.Filter.__iter__
66 60 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.__init__ call site: 00060 bleach._vendor.html5lib._inputstream.HTMLBinaryInputStream.__init__
32 238 bleach._vendor.html5lib._tokenizer.HTMLTokenizer.__iter__ call site: 00238 bleach._vendor.html5lib._tokenizer.HTMLTokenizer.consumeEntity
21 274 bleach._vendor.html5lib._trie.py.Trie.has_keys_with_prefix call site: 00274 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.char
19 828 bleach.sanitizer.BleachSanitizerFilter.merge_characters call site: 00828 bleach._vendor.html5lib.filters.optionaltags.Filter.__iter__
14 153 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.readChunk call site: 00153 bleach._vendor.html5lib._utils.isSurrogatePair
14 649 bleach._vendor.html5lib._tokenizer.HTMLTokenizer.__iter__ call site: 00649 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.charsUntil
13 46 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.__init__ call site: 00046 bleach._vendor.html5lib._inputstream.BufferedStream.seek
11 954 bleach.sanitizer.BleachSanitizerFilter.sanitize_uri_value call site: 00954 normalized_uri.split
10 417 bleach._vendor.html5lib._tokenizer.HTMLTokenizer.__iter__ call site: 00417 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.charsUntil
9 694 bleach._vendor.html5lib._tokenizer.HTMLTokenizer.__iter__ call site: 00694 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.char

Runtime coverage analysis

Covered functions
287
Functions that are reachable but not covered
213
Reachable functions
312
Percentage of reachable functions covered
31.73%
NB: The sum of covered functions and functions that are reachable but not covered need not be equal to Reachable functions . This is because the reachability analysis is an approximation and thus at runtime some functions may be covered that are not included in the reachability analysis. This is a limitation of our static analysis capabilities.
Function name source code lines source lines hit percentage hit

Files reached

filename functions hit
/ 1
...sanitize_fuzzer 3
bleach 2
bleach.sanitizer 50
bleach.html5lib_shim 33
bleach._vendor.html5lib.serializer 29
bleach._vendor.html5lib.html5parser 22
bleach._vendor.html5lib._tokenizer 94
bleach._vendor.html5lib._inputstream 61
bleach._vendor.html5lib._utils 2
bleach._vendor.html5lib._trie.py 3
bleach._vendor.html5lib._trie._base 2
bleach._vendor.html5lib.filters.whitespace 8
bleach._vendor.html5lib.filters.optionaltags 5
bleach._vendor.html5lib.filters.inject_meta_charset 13
bleach.linkifier 29
bleach._vendor.html5lib.filters.alphabeticalattributes 10
bleach._vendor.html5lib.filters.sanitizer 32

Fuzzer: linkify_fuzzer

Call tree

The calltree shows the control flow of the fuzzer. This is overlaid with coverage information to display how much of the potential code a fuzzer can reach is in fact covered at runtime. In the following there is a link to a detailed calltree visualisation as well as a bitmap showing a high-level view of the calltree. For further information about these topics please see the glossary for full calltree and calltree overview

Call tree overview bitmap:

The distribution of callsites in terms of coloring is
Color Runtime hitcount Callsite count Percentage
red 0 505 48.9%
gold [1:9] 0 0.0%
yellow [10:29] 0 0.0%
greenyellow [30:49] 0 0.0%
lawngreen 50+ 526 51.0%
All colors 1031 100

Fuzz blockers

The following nodes represent call sites where fuzz blockers occur.

Amount of callsites blocked Calltree index Parent function Callsite Largest blocked function
69 56 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.__init__ call site: 00056 bleach._vendor.html5lib._inputstream.HTMLBinaryInputStream.__init__
62 914 bleach.sanitizer.BleachSanitizerFilter.sanitize_stream call site: 00914 bleach._vendor.html5lib.filters.whitespace.Filter.__iter__
48 799 bleach._vendor.html5lib._trie.py.Trie.has_keys_with_prefix call site: 00799 bleach._vendor.html5lib.filters.alphabeticalattributes.Filter.__iter__
21 764 bleach.html5lib_shim.BleachHTMLParser._parse call site: 00764 bleach._vendor.html5lib.html5parser.HTMLParser.mainLoop
15 850 bleach.sanitizer.BleachSanitizerFilter.merge_characters call site: 00850 bleach._vendor.html5lib.filters.alphabeticalattributes.Filter.__iter__
14 156 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.readChunk call site: 00156 bleach._vendor.html5lib._utils.isSurrogatePair
14 662 bleach._vendor.html5lib._tokenizer.HTMLTokenizer.__iter__ call site: 00662 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.charsUntil
13 41 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.__init__ call site: 00041 bleach._vendor.html5lib._inputstream.BufferedStream.seek
11 891 bleach.sanitizer.BleachSanitizerFilter.sanitize_uri_value call site: 00891 normalized_uri.split
10 597 bleach._vendor.html5lib._tokenizer.HTMLTokenizer.__iter__ call site: 00597 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.charsUntil
9 703 bleach._vendor.html5lib._tokenizer.HTMLTokenizer.__iter__ call site: 00703 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.char
8 263 bleach._vendor.html5lib._tokenizer.HTMLTokenizer.__iter__ call site: 00263 bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.char

Runtime coverage analysis

Covered functions
287
Functions that are reachable but not covered
192
Reachable functions
290
Percentage of reachable functions covered
33.79%
NB: The sum of covered functions and functions that are reachable but not covered need not be equal to Reachable functions . This is because the reachability analysis is an approximation and thus at runtime some functions may be covered that are not included in the reachability analysis. This is a limitation of our static analysis capabilities.
Function name source code lines source lines hit percentage hit

Files reached

filename functions hit
/ 1
...linkify_fuzzer 3
bleach 2
bleach.linkifier 37
bleach.html5lib_shim 33
bleach._vendor.html5lib.serializer 29
bleach._vendor.html5lib.html5parser 22
bleach._vendor.html5lib._tokenizer 89
bleach._vendor.html5lib._inputstream 62
bleach._vendor.html5lib._utils 2
bleach._vendor.html5lib.filters.optionaltags 5
bleach._vendor.html5lib.filters.inject_meta_charset 13
bleach._vendor.html5lib._trie.py 3
bleach._vendor.html5lib.filters.alphabeticalattributes 10
bleach.sanitizer 38
bleach._vendor.html5lib.filters.whitespace 8
bleach._vendor.html5lib.filters.sanitizer 9

Analyses and suggestions

Optimal target analysis

Remaining optimal interesting functions

The following table shows a list of functions that are optimal targets. Optimal targets are identified by finding the functions that in combination, yield a high code coverage.

Func name Functions filename Arg count Args Function depth hitcount instr count bb count cyclomatic complexity Reachable functions Incoming references total cyclomatic complexity Unreached complexity
bleach._vendor.parse.urljoin bleach._vendor.parse 3 ['N/A', 'N/A', 'N/A'] 5 0 4 12 8 36 0 126 114
bleach._vendor.html5lib.treewalkers.base.NonRecursiveTreeWalker.__iter__ bleach._vendor.html5lib.treewalkers.base 1 ['N/A'] 2 0 8 13 8 16 0 57 54
bleach._vendor.parse.urlencode bleach._vendor.parse 6 ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] 4 0 6 9 7 19 0 69 54
bleach._vendor.html5lib.html5parser.getPhases.InBodyPhase.startTagA bleach._vendor.html5lib.html5parser 2 ['N/A', 'N/A'] 2 0 6 3 4 16 0 59 53
bleach._vendor.html5lib.treebuilders.etree_lxml.TreeBuilder.insertRoot bleach._vendor.html5lib.treebuilders.etree_lxml 2 ['N/A', 'N/A'] 2 0 5 7 6 17 0 57 51
bleach._vendor.html5lib.treebuilders.etree_lxml.testSerializer.serializeElement bleach._vendor.html5lib.treebuilders.etree_lxml 2 ['N/A', 'N/A'] 2 0 15 12 8 15 2 58 46
bleach._vendor.html5lib._inputstream.EncodingParser.handleMeta bleach._vendor.html5lib._inputstream 1 ['N/A'] 3 0 0 10 7 18 0 70 45
bleach._vendor.html5lib._utils.moduleFactoryFactory.moduleFactory bleach._vendor.html5lib._utils 3 ['N/A', 'N/A', 'N/A'] 2 0 1 4 5 14 0 47 38
bleach._vendor.parse.parse_qsl bleach._vendor.parse 7 ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] 3 0 3 8 6 18 1 64 36

Implementing fuzzers that target the above functions will improve reachability such that it becomes:

Functions statically reachable by fuzzers
28.9%
214 / 738
Cyclomatic complexity statically reachable by fuzzers
35.0%
904 / 2617

All functions overview

If you implement fuzzers for these functions, the status of all functions in the project will be:

Func name Functions filename Args Function call depth Reached by Fuzzers Runtime reached by Fuzzers Combined reached by Fuzzers Fuzzers runtime hit Func lines hit % I Count BB Count Cyclomatic complexity Functions reached Reached by functions Accumulated cyclomatic complexity Undiscovered complexity

Fuzz engine guidance

This sections provides heuristics that can be used as input to a fuzz engine when running a given fuzz target. The current focus is on providing input that is usable by libFuzzer.

/src/sanitize_fuzzer.py

Dictionary

Use this with the libFuzzer -dict=DICT.file flag


Fuzzer function priority

Use one of these functions as input to libfuzzer with flag: -focus_function name

-focus_function=['bleach.sanitizer.BleachSanitizerFilter.sanitize_stream', 'bleach.html5lib_shim.match_entity', 'bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.__init__', 'bleach._vendor.html5lib._tokenizer.HTMLTokenizer.__iter__', 'bleach._vendor.html5lib._trie.py.Trie.has_keys_with_prefix', 'bleach.sanitizer.BleachSanitizerFilter.merge_characters', 'bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.readChunk', 'bleach.sanitizer.BleachSanitizerFilter.sanitize_uri_value']

/src/linkify_fuzzer.py

Dictionary

Use this with the libFuzzer -dict=DICT.file flag


Fuzzer function priority

Use one of these functions as input to libfuzzer with flag: -focus_function name

-focus_function=['bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.__init__', 'bleach.sanitizer.BleachSanitizerFilter.sanitize_stream', 'bleach._vendor.html5lib._trie.py.Trie.has_keys_with_prefix', 'bleach.html5lib_shim.BleachHTMLParser._parse', 'bleach.sanitizer.BleachSanitizerFilter.merge_characters', 'bleach._vendor.html5lib._inputstream.HTMLUnicodeInputStream.readChunk', 'bleach._vendor.html5lib._tokenizer.HTMLTokenizer.__iter__', 'bleach.sanitizer.BleachSanitizerFilter.sanitize_uri_value']

Files and Directories in report

This section shows which files and directories are considered in this report. The main reason for showing this is fuzz introspector may include more code in the reasoning than is desired. This section helps identify if too many files/directories are included, e.g. third party code, which may be irrelevant for the threat model. In the event too much is included, fuzz introspector supports a configuration file that can exclude data from the report. See the following link for more information on how to create a config file: link

Files in report

Source file Reached by Covered by
[] []
bleach.css_sanitizer [] []
re [] []
bleach._vendor.html5lib.treewalkers.base [] []
bleach.parse_shim [] []
bleach._vendor.html5lib.treebuilders [] []
bleach.six_shim [] []
bisect [] []
operator [] []
...linkify_fuzzer ['linkify_fuzzer'] []
codecs [] []
bleach._vendor.html5lib.treewalkers [] []
tinycss2 [] []
xml [] []
types [] []
genshi [] []
bleach._vendor [] []
io [] []
bleach.sanitizer ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach.linkifier ['sanitize_fuzzer', 'linkify_fuzzer'] []
[] []
chardet [] []
bleach._vendor.html5lib.treeadapters [] []
bleach._vendor.html5lib.filters [] []
bleach._vendor.html5lib.treewalkers.dom [] []
bleach._vendor.html5lib._trie._base ['sanitize_fuzzer'] []
bleach._vendor.html5lib.filters.sanitizer ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach._vendor.html5lib.filters.whitespace ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach._vendor.html5lib._utils ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach._vendor.html5lib._ihatexml [] []
lxml [] []
bleach._vendor.html5lib._inputstream ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach._vendor.html5lib.treebuilders.etree [] []
bleach._vendor.html5lib.filters.lint [] []
bleach._vendor.html5lib.treebuilders.dom [] []
weakref [] []
itertools [] []
bleach._vendor.html5lib._trie [] []
bleach._vendor.html5lib.treewalkers.etree [] []
atheris [] []
bleach._vendor.html5lib.filters.inject_meta_charset ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach._vendor.html5lib.serializer ['sanitize_fuzzer', 'linkify_fuzzer'] []
collections [] []
sys [] []
copy [] []
bleach._vendor.html5lib.constants [] []
bleach._vendor.html5lib.treebuilders.etree_lxml [] []
bleach.html5lib_shim ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach._vendor.html5lib.html5parser ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach._vendor.html5lib.filters.base [] []
bleach._vendor.html5lib.treebuilders.base [] []
unicodedata [] []
bleach.callbacks [] []
bleach._vendor.html5lib.treewalkers.etree_lxml [] []
bleach._vendor.html5lib.filters.alphabeticalattributes ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach._vendor.html5lib [] []
...sanitize_fuzzer ['sanitize_fuzzer'] []
bleach._vendor.html5lib._trie.py ['sanitize_fuzzer', 'linkify_fuzzer'] []
webencodings [] []
urllib [] []
bleach._vendor.html5lib.treeadapters.sax [] []
bleach._vendor.parse [] []
bleach._vendor.html5lib._tokenizer ['sanitize_fuzzer', 'linkify_fuzzer'] []
bleach._vendor.html5lib.filters.optionaltags ['sanitize_fuzzer', 'linkify_fuzzer'] []
warnings [] []
bleach._vendor.html5lib.treeadapters.genshi [] []
bleach._vendor.html5lib.treewalkers.genshi [] []

Directories in report

Directory