Project overview: tomlkit
High level conclusions
Reachability and coverage overview
Warning:
The number of runtime covered functions are larger than the
number of reachable functions. This means that Fuzz Introspector found
there are more functions covered at runtime than what is considered
reachable based on the static analysis. This is a limitation in the
analysis as anything covered at runtime is by definition reachable by the
fuzzers.
This is likely due to a limitation in the static analysis. In this case, the
count of functions covered at runtime is the true value, which means this
is what should be considered "achieved" by the fuzzer.
Use the project functions table below to query all functions that were not covered at runtime.
Project functions overview
The following table shows data about each function in the project. The functions included in this table correspond to all functions that exist in the executables of the fuzzers. As such, there may be functions that are from third-party libraries.
For further technical details on the meaning of columns in the below table, please see the Glossary .
| Func name | Functions filename | Args | Function call depth | Reached by Fuzzers | Runtime reached by Fuzzers | Combined reached by Fuzzers | Fuzzers runtime hit | Func lines hit % | I Count | BB Count | Cyclomatic complexity | Functions reached | Reached by functions | Accumulated cyclomatic complexity | Undiscovered complexity |
|---|
Fuzzer details
Fuzzer: fuzz_parser
Call tree
The calltree shows the control flow of the fuzzer. This is overlaid with coverage information to display how much of the potential code a fuzzer can reach is in fact covered at runtime. In the following there is a link to a detailed calltree visualisation as well as a bitmap showing a high-level view of the calltree. For further information about these topics please see the glossary for full calltree and calltree overview
Call tree overview bitmap:
The distribution of callsites in terms of coloring is
| Color | Runtime hitcount | Callsite count | Percentage |
|---|---|---|---|
| red | 0 | 198 | 26.2% |
| gold | [1:9] | 0 | 0.0% |
| yellow | [10:29] | 0 | 0.0% |
| greenyellow | [30:49] | 0 | 0.0% |
| lawngreen | 50+ | 556 | 73.7% |
| All colors | 754 | 100 |
Fuzz blockers
The following nodes represent call sites where fuzz blockers occur.
| Amount of callsites blocked | Calltree index | Parent function | Callsite | Largest blocked function |
|---|---|---|---|---|
| 23 | 601 | tomlkit._utils.parse_rfc3339 | call site: 00601 | m.group |
| 17 | 5 | tomlkit._compat.decode | call site: 00005 | contextlib.suppress |
| 12 | 469 | tomlkit.container.Container._replace_at | call site: 00469 | tomlkit.items.Table.append |
| 11 | 361 | tomlkit.items.Time.__init__ | call site: 00361 | collections.abc.MutableSequence.isoformat |
| 11 | 438 | tomlkit.container.Container._replace_at | call site: 00438 | tomlkit.container.Container._insert_at |
| 11 | 646 | tomlkit.parser.Parser._parse_value | call site: 00646 | tomlkit._utils.parse_rfc3339 |
| 10 | 276 | tomlkit.items.item | call site: 00276 | datetime.time.items |
| 10 | 338 | tomlkit.items.item | call site: 00338 | tomlkit.items.DateTime.__init__ |
| 9 | 349 | tomlkit.items.item | call site: 00349 | tomlkit.items.Date.__init__ |
| 7 | 319 | tomlkit.items.item | call site: 00319 | datetime.time.items |
| 7 | 625 | tomlkit._utils.parse_rfc3339 | call site: 00625 | m.group |
| 6 | 294 | tomlkit.items.AoT.__init__ | call site: 00294 | tomlkit.items.item |
Runtime coverage analysis
| Function name | source code lines | source lines hit | percentage hit |
|---|
Files reached
| filename | functions hit |
|---|---|
| / | 1 |
| ...fuzz_parser | 4 |
| tomlkit.parser | 102 |
| tomlkit._compat | 10 |
| tomlkit.source | 10 |
| tomlkit.toml_char | 2 |
| tomlkit.items | 67 |
| tomlkit._utils | 19 |
| tomlkit.container | 61 |
Fuzzer: fuzz_dumps
Call tree
The calltree shows the control flow of the fuzzer. This is overlaid with coverage information to display how much of the potential code a fuzzer can reach is in fact covered at runtime. In the following there is a link to a detailed calltree visualisation as well as a bitmap showing a high-level view of the calltree. For further information about these topics please see the glossary for full calltree and calltree overview
Call tree overview bitmap:
The distribution of callsites in terms of coloring is
| Color | Runtime hitcount | Callsite count | Percentage |
|---|---|---|---|
| red | 0 | 84 | 42.2% |
| gold | [1:9] | 0 | 0.0% |
| yellow | [10:29] | 0 | 0.0% |
| greenyellow | [30:49] | 0 | 0.0% |
| lawngreen | 50+ | 115 | 57.7% |
| All colors | 199 | 100 |
Fuzz blockers
The following nodes represent call sites where fuzz blockers occur.
| Amount of callsites blocked | Calltree index | Parent function | Callsite | Largest blocked function |
|---|---|---|---|---|
| 17 | 108 | tomlkit._compat.decode | call site: 00108 | contextlib.suppress |
| 11 | 164 | tomlkit.items.Time.__init__ | call site: 00164 | datetime.datetime.isoformat |
| 10 | 31 | tomlkit.items.item | call site: 00031 | datetime.date.items |
| 10 | 141 | tomlkit.items.item | call site: 00141 | tomlkit.items.DateTime.__init__ |
| 9 | 152 | tomlkit.items.item | call site: 00152 | tomlkit.items.Date.__init__ |
| 7 | 93 | tomlkit.items.item | call site: 00093 | builtins.int.items |
| 6 | 49 | tomlkit.items.AoT.__init__ | call site: 00049 | tomlkit.items.item |
| 3 | 43 | tomlkit.items.item | call site: 00043 |
|
| 3 | 179 | tomlkit.items.Array.as_string | call site: 00179 | v.value.as_string |
| 1 | 1 | ...fuzz_dumps.test_one_input | call site: 00001 | fdp.ConsumeInt |
| 1 | 24 | tomlkit.items.item | call site: 00024 |
|
| 1 | 57 | tomlkit.items.Table.append | call site: 00057 | tomlkit.items.item |
Runtime coverage analysis
| Function name | source code lines | source lines hit | percentage hit |
|---|
Files reached
| filename | functions hit |
|---|---|
| / | 1 |
| ...fuzz_dumps | 4 |
| tomlkit.api | 18 |
| tomlkit.items | 63 |
| tomlkit._compat | 10 |
| tomlkit._utils | 7 |
Analyses and suggestions
Optimal target analysis
Remaining optimal interesting functions
The following table shows a list of functions that are optimal targets. Optimal targets are identified by finding the functions that in combination, yield a high code coverage.
| Func name | Functions filename | Arg count | Args | Function depth | hitcount | instr count | bb count | cyclomatic complexity | Reachable functions | Incoming references | total cyclomatic complexity | Unreached complexity |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
tomlkit.container.Container.as_string
|
tomlkit.container | 1 | ['N/A'] | 4 | 0 | 1 | 5 | 5 | 26 | 0 | 90 | 48 |
Implementing fuzzers that target the above functions will improve reachability such that it becomes:
All functions overview
If you implement fuzzers for these functions, the status of all functions in the project will be:
| Func name | Functions filename | Args | Function call depth | Reached by Fuzzers | Runtime reached by Fuzzers | Combined reached by Fuzzers | Fuzzers runtime hit | Func lines hit % | I Count | BB Count | Cyclomatic complexity | Functions reached | Reached by functions | Accumulated cyclomatic complexity | Undiscovered complexity |
|---|
Fuzz engine guidance
This sections provides heuristics that can be used as input to a fuzz engine when running a given fuzz target. The current focus is on providing input that is usable by libFuzzer.
/src/fuzz_parser.py
Dictionary
Use this with the libFuzzer -dict=DICT.file flag
Fuzzer function priority
Use one of these functions as input to libfuzzer with flag: -focus_function name
-focus_function=['tomlkit._utils.parse_rfc3339', 'tomlkit._compat.decode', 'tomlkit.container.Container._replace_at', 'tomlkit.items.Time.__init__', 'tomlkit.parser.Parser._parse_value', 'tomlkit.items.item']/src/fuzz_dumps.py
Dictionary
Use this with the libFuzzer -dict=DICT.file flag
Fuzzer function priority
Use one of these functions as input to libfuzzer with flag: -focus_function name
-focus_function=['tomlkit._compat.decode', 'tomlkit.items.Time.__init__', 'tomlkit.items.item', 'tomlkit.items.AoT.__init__', 'tomlkit.items.Array.as_string', '...fuzz_dumps.test_one_input']Runtime coverage analysis
This section shows analysis of runtime coverage data.
For futher technical details on how this section is generated, please see the Glossary .
Complex functions with low coverage
| Func name | Function total lines | Lines covered at runtime | percentage covered | Reached by fuzzers |
|---|---|---|---|---|
| tomlkit.items.Array.add_line | 39 | 0 | 0.0% | [] |
| tomlkit.items.Array.__delitem__ | 43 | 0 | 0.0% | [] |
| tomlkit.items.InlineTable.as_string | 31 | 15 | 48.38% | ['fuzz_dumps', 'fuzz_parser'] |
| tomlkit.container.Container._replace_at | 40 | 16 | 40.0% | ['fuzz_dumps', 'fuzz_parser'] |
| tomlkit._utils.parse_rfc3339 | 43 | 18 | 41.86% | ['fuzz_dumps', 'fuzz_parser'] |
Files and Directories in report
This section shows which files and directories are considered in this report. The main reason for showing this is fuzz introspector may include more code in the reasoning than is desired. This section helps identify if too many files/directories are included, e.g. third party code, which may be irrelevant for the threat model. In the event too much is included, fuzz introspector supports a configuration file that can exclude data from the report. See the following link for more information on how to create a config file: link
Files in report
| Source file | Reached by | Covered by |
|---|---|---|
| [] | [] | |
| tomlkit.api | ['fuzz_dumps'] | [] |
| tomlkit.toml_document | [] | [] |
| dictgen.utils | [] | [] |
| copy | [] | [] |
| tomlkit._utils | ['fuzz_parser', 'fuzz_dumps'] | [] |
| typing | [] | [] |
| tomlkit.items | ['fuzz_parser', 'fuzz_dumps'] | [] |
| ...fuzz_dumps | ['fuzz_dumps'] | [] |
| contextlib | [] | [] |
| tomlkit.toml_char | ['fuzz_parser'] | [] |
| random | [] | [] |
| numbers | [] | [] |
| tomlkit.toml_file | [] | [] |
| math | [] | [] |
| abc | [] | [] |
| atheris | [] | [] |
|
|
[] | [] |
| dictgen | [] | [] |
| collections | [] | [] |
| tomlkit | [] | [] |
| tomlkit.exceptions | [] | [] |
| inspect | [] | [] |
| re | [] | [] |
| datetime | [] | [] |
| tomlkit.parser | ['fuzz_parser'] | [] |
| ...fuzz_parser | ['fuzz_parser'] | [] |
| tomlkit.source | ['fuzz_parser'] | [] |
| builtins | [] | [] |
| tomlkit._types | [] | [] |
| dictgen.generate | [] | [] |
| dataclasses | [] | [] |
| tomlkit._compat | ['fuzz_parser', 'fuzz_dumps'] | [] |
| tomlkit.container | ['fuzz_parser'] | [] |
Directories in report
| Directory |
|---|
Metadata section
This sections shows the raw data that is used to produce this report. This is mainly used for further processing and developer debugging.
| Fuzzer | Calltree file | Program data file | Coverage file |
|---|---|---|---|
| fuzz_parser | fuzzerLogFile-fuzz_parser.data | fuzzerLogFile-fuzz_parser.data.yaml | all_cov.json |
| fuzz_dumps | fuzzerLogFile-fuzz_dumps.data | fuzzerLogFile-fuzz_dumps.data.yaml | all_cov.json |