Fuzz introspector
For issues and ideas: https://github.com/ossf/fuzz-introspector/issues
Project coverage

Table of contents

Project overview: setuptools
High level conclusions
Reachability and coverage overview
Fuzzers overview
Project functions overview
Fuzzer details
Fuzzer: fuzz_config_pyprojecttoml
Call tree
Fuzz blockers
Runtime coverage analysis
Files reached
Analyses and suggestions
Optimal target analysis
Remaining optimal interesting functions
All functions overview
Fuzz engine guidance
/src/fuzz_config_pyprojecttoml.py
Dictionary
Fuzzer function priority
Runtime coverage analysis
Complex functions with low coverage
Files and Directories in report
Files in report
Directories in report
Metadata section
Report generation date: 2024-09-08

Project overview: setuptools

High level conclusions

Reachability and coverage overview

Functions statically reachable by fuzzers
2.0%
76 / 3998
Cyclomatic complexity statically reachable by fuzzers
3.0%
429 / 13975
Runtime code coverage of functions
1.0%
36 / 3998

Fuzzers overview

Fuzzer Fuzzer filename Functions Reached Functions unreached Fuzzer depth Files reached Basic blocks reached Cyclomatic complexity Details
fuzz_config_pyprojecttoml /src/fuzz_config_pyprojecttoml.py 227 6718 10 13 513 879 fuzz_config_pyprojecttoml.py

Project functions overview

The following table shows data about each function in the project. The functions included in this table correspond to all functions that exist in the executables of the fuzzers. As such, there may be functions that are from third-party libraries.

For further technical details on the meaning of columns in the below table, please see the Glossary .

Func name Functions filename Args Function call depth Reached by Fuzzers Fuzzers runtime hit Func lines hit % I Count BB Count Cyclomatic complexity Functions reached Reached by functions Accumulated cyclomatic complexity Undiscovered complexity

Fuzzer details

Fuzzer: fuzz_config_pyprojecttoml

Call tree

The calltree shows the control flow of the fuzzer. This is overlaid with coverage information to display how much of the potential code a fuzzer can reach is in fact covered at runtime. In the following there is a link to a detailed calltree visualisation as well as a bitmap showing a high-level view of the calltree. For further information about these topics please see the glossary for full calltree and calltree overview

Full calltree

Call tree overview bitmap:

The distribution of callsites in terms of coloring is
Color Runtime hitcount Callsite count Percentage
red 0 809 99.6%
gold [1:9] 0 0.0%
yellow [10:29] 0 0.0%
greenyellow [30:49] 0 0.0%
lawngreen 50+ 3 0.36%
All colors 812 100

Fuzz blockers

The following nodes represent call sites where fuzz blockers occur.

Amount of callsites blocked Calltree index Parent function Callsite Largest blocked function
756 55 setuptools.config._validate_pyproject.fastjsonschema_validations.validate_https___packaging_python_org_en_latest_specifications_declaring_build_dependencies call site: 00055 setuptools.config.pyprojecttoml.expand_configuration
52 0 EP call site: 00000 setuptools.config.pyprojecttoml.read_configuration
1 53 setuptools.config._validate_pyproject.fastjsonschema_validations.validate_https___packaging_python_org_en_latest_specifications_declaring_build_dependencies call site: 00053 .isinstance

Runtime coverage analysis

Covered functions
71
Functions that are reachable but not covered
223
Reachable functions
227
Percentage of reachable functions covered
1.76%
NB: The sum of covered functions and functions that are reachable but not covered need not be equal to Reachable functions . This is because the reachability analysis is an approximation and thus at runtime some functions may be covered that are not included in the reachability analysis. This is a limitation of our static analysis capabilities.
Function name source code lines source lines hit percentage hit

Files reached

filename functions hit
/ 1
...fuzz_config_pyprojecttoml 5
setuptools.config.pyprojecttoml 65
setuptools.warnings 11
setuptools.config._validate_pyproject 3
setuptools.config._validate_pyproject.fastjsonschema_validations 63
setuptools.config.expand 56
setuptools._path 5
setuptools.discovery 20
distutils.util 2
setuptools.dist 24
setuptools._reqs 4
setuptools.config._apply_pyprojecttoml 2

Analyses and suggestions

Optimal target analysis

Remaining optimal interesting functions

The following table shows a list of functions that are optimal targets. Optimal targets are identified by finding the functions that in combination, yield a high code coverage.

Func name Functions filename Arg count Args Function depth hitcount instr count bb count cyclomatic complexity Reachable functions Incoming references total cyclomatic complexity Unreached complexity
setuptools.command.develop.develop.install_for_development setuptools.command.develop 1 ['N/A'] 20 0 8 2 4 305 1 989 881
setuptools._vendor.wheel.bdist_wheel.bdist_wheel.run setuptools._vendor.wheel.bdist_wheel 1 ['N/A'] 8 0 14 7 6 214 0 715 589
setuptools._vendor.backports.tarfile.TarFile.extractall setuptools._vendor.backports.tarfile 5 ['N/A', 'N/A', 'N/A', 'N/A', 'N/A'] 9 0 8 3 4 124 0 411 357

Implementing fuzzers that target the above functions will improve reachability such that it becomes:

Functions statically reachable by fuzzers
7.00%
296 / 3998
Cyclomatic complexity statically reachable by fuzzers
9.0%
1265 / 13975

All functions overview

If you implement fuzzers for these functions, the status of all functions in the project will be:

Func name Functions filename Args Function call depth Reached by Fuzzers Fuzzers runtime hit Func lines hit % I Count BB Count Cyclomatic complexity Functions reached Reached by functions Accumulated cyclomatic complexity Undiscovered complexity

Fuzz engine guidance

This sections provides heuristics that can be used as input to a fuzz engine when running a given fuzz target. The current focus is on providing input that is usable by libFuzzer.

/src/fuzz_config_pyprojecttoml.py

Dictionary

Use this with the libFuzzer -dict=DICT.file flag


Fuzzer function priority

Use one of these functions as input to libfuzzer with flag: -focus_function name 

-focus_function=['setuptools.config._validate_pyproject.fastjsonschema_validations.validate_https___packaging_python_org_en_latest_specifications_declaring_build_dependencies']

Runtime coverage analysis

This section shows analysis of runtime coverage data.

For futher technical details on how this section is generated, please see the Glossary .

Complex functions with low coverage

Func name Function total lines Lines covered at runtime percentage covered Reached by fuzzers
setuptools.dist.Distribution._parse_config_files 37 0 0.0% []
setuptools._imp.find_module 31 0 0.0% []
_itertools.only 62 22 35.48% []
setuptools._core_metadata.write_pkg_file.write_field 38 0 0.0% []
k.strip 103 36 34.95% []
jaraco.functools.method_cache 157 3 1.910% []
zipp.Path 181 23 12.70% []

Files and Directories in report

This section shows which files and directories are considered in this report. The main reason for showing this is fuzz introspector may include more code in the reasoning than is desired. This section helps identify if too many files/directories are included, e.g. third party code, which may be irrelevant for the threat model. In the event too much is included, fuzz introspector supports a configuration file that can exclude data from the report. See the following link for more information on how to create a config file: link

Files in report

Source file Reached by Covered by
[] []
bz2 [] []
setuptools.package_index [] []
setuptools._distutils._itertools [] []
distutils._modified [] []
setuptools._distutils.dep_util [] []
tarfile [] []
setuptools.sandbox [] []
_utils [] []
setuptools._vendor.wheel.vendored.packaging._parser [] []
setuptools._vendor.wheel.vendored [] []
_re [] []
setuptools._vendor.typing_extensions [] []
importlib_metadata [] []
setuptools._distutils.filelist [] []
setuptools._vendor.tomli._re [] []
configparser [] []
distutils.file_util [] []
traceback [] []
setuptools.command.editable_wheel [] []
distutils.cmd [] []
setuptools._vendor.packaging.tags [] []
setuptools.config [] []
_memo [] []
readers [] []
zlib [] []
distutils.spawn [] []
copy [] []
setuptools._vendor.wheel.vendored.packaging.utils [] []
py38 [] []
specifiers [] []
argparse [] []
setuptools._vendor.importlib_metadata.compat [] []
json [] []
glob [] []
setuptools.command.setopt [] []
distutils.command.build_scripts [] []
setuptools._vendor.wheel._setuptools_logging [] []
distutils.dist [] []
setuptools.compat.py311 [] []
setuptools._vendor.typeguard._functions [] []
distutils.command.build_py [] []
text_file [] []
setuptools._vendor.jaraco.text.strip-prefix [] []
tags [] []
setuptools.command.build [] []
setuptools._distutils._macos_compat [] []
setuptools._distutils._functools [] []
setuptools.command.install_egg_info [] []
setuptools._distutils.errors [] []
setuptools._vendor.more_itertools.more [] []
struct [] []
pkg_resources [] []
os [] []
setuptools._vendor.importlib_resources.compat.py38 [] []
distutils.debug [] []
setuptools.archive_util [] []
setuptools._distutils.dist [] []
setuptools._vendor.platformdirs.android [] []
setuptools._vendor.autocommand.autocommand [] []
distutils.filelist [] []
distutils.dir_util [] []
types [] []
tomli [] []
setuptools._vendor.typeguard._transformer [] []
_tokenizer [] []
socket [] []
setuptools._distutils.command.install_scripts [] []
requirements [] []
itertools [] []
setuptools._vendor.importlib_resources.compat.py39 [] []
more_itertools [] []
setuptools._distutils._log [] []
_manylinux [] []
dist [] []
io [] []
setuptools._vendor.packaging._parser [] []
setuptools._vendor.inflect.compat.py38 [] []
setuptools._vendor.autocommand [] []
collections [] []
distutils.version [] []
setuptools._distutils.compat.py38 [] []
setuptools._distutils.text_file [] []
zipfile [] []
setuptools._vendor.packaging.requirements [] []
setuptools.installer [] []
markers [] []
autoasync [] []
setuptools._vendor.typeguard._exceptions [] []
setuptools._distutils.cmd [] []
setuptools._distutils.command.install_egg_info [] []
_modified [] []
setuptools._distutils.command.install_lib [] []
heapq [] []
setuptools._vendor.wheel.cli.unpack [] []
packaging [] []
setuptools._vendor.typeguard._config [] []
distutils.compat [] []
utils [] []
[] []
stat [] []
distutils.errors [] []
setuptools._vendor.tomli._parser [] []
setuptools._vendor.importlib_metadata.compat.py39 [] []
setuptools._core_metadata [] []
filelist [] []
setuptools.config._validate_pyproject.extra_validations [] []
main [] []
setuptools._distutils.sysconfig [] []
setuptools._distutils.command._framework_compat [] []
_itertools [] []
archive_util [] []
setuptools._vendor.packaging.markers [] []
setuptools._distutils.compat.py39 [] []
gzip [] []
setuptools._vendor.more_itertools.recipes [] []
setuptools._vendor.importlib_resources.simple [] []
setuptools.command.saveopts [] []
distutils.fancy_getopt [] []
setuptools._vendor.typeguard._pytest_plugin [] []
setuptools._vendor.packaging._elffile [] []
_parser [] []
setuptools._vendor.jaraco.text.layouts [] []
setuptools._distutils.versionpredicate [] []
setuptools._distutils.cygwinccompiler [] []
setuptools._distutils.command.install_headers [] []
setuptools._distutils.spawn [] []
setuptools._vendor.tomli._types [] []
setuptools [] []
setuptools.config._validate_pyproject.fastjsonschema_exceptions [] []
setuptools._vendor.wheel.vendored.packaging._manylinux [] []
setuptools._vendor.platformdirs.unix [] []
setuptools.errors [] []
setuptools.config._validate_pyproject.error_reporting [] []
setuptools._vendor.backports [] []
setuptools._distutils.command.check [] []
setuptools._vendor.typeguard._importhook [] []
fnmatch [] []
unicodedata [] []
setuptools._vendor.importlib_metadata._text [] []
distutils.core [] []
setuptools.command.install [] []
warnings [] []
setuptools._vendor.wheel.cli.tags [] []
dataclasses [] []
setuptools._distutils.command.bdist_dumb [] []
site [] []
compat [] []
setuptools._distutils.core [] []
setuptools._vendor.wheel.metadata [] []
platform [] []
contextlib [] []
distutils.ccompiler [] []
setuptools.namespaces [] []
setuptools._distutils.util [] []
setuptools._distutils.command.register [] []
setuptools._vendor.platformdirs.version [] []
subprocess [] []
ctypes [] []
dir_util [] []
setuptools._vendor.wheel.cli [] []
setuptools._vendor.platformdirs.api [] []
setuptools.command.rotate [] []
util [] []
shlex [] []
pack [] []
setuptools.command.easy_install [] []
setuptools._vendor.packaging.utils [] []
setuptools._vendor.importlib_metadata [] []
setuptools._vendor.importlib_resources._itertools [] []
distutils.text_file [] []
setuptools._vendor.autocommand.autoasync [] []
Cython [] []
setuptools._vendor.wheel.vendored.packaging [] []
setuptools.command.bdist_egg [] []
wheel [] []
setuptools.launch [] []
setuptools._vendor.backports.tarfile.compat.py38 [] []
distutils.extension [] []
setuptools._distutils.config [] []
functools [] []
distutils.command.sdist [] []
setuptools._distutils.version [] []
setuptools.config._validate_pyproject.formats [] []
setuptools.depends [] []
setuptools.build_meta [] []
autocommand [] []
winreg [] []
_checkers [] []
shutil [] []
setuptools._distutils.command.build_ext [] []
setuptools._vendor.wheel.vendored.packaging.requirements [] []
setuptools.dist ['fuzz_config_pyprojecttoml'] []
distutils._msvccompiler [] []
importlib [] []
setuptools._vendor.wheel.cli.convert [] []
unittest [] []
setuptools._distutils.command.install [] []
_functools [] []
setuptools._vendor.typeguard._decorators [] []
setuptools._vendor.typeguard._suppression [] []
setuptools._vendor.importlib_metadata.diagnose [] []
setuptools._distutils.bcppcompiler [] []
distutils.command._framework_compat [] []
setuptools._entry_points [] []
setuptools.config.pyprojecttoml ['fuzz_config_pyprojecttoml'] []
ccompiler [] []
_config [] []
setuptools.command.test [] []
_exceptions [] []
asyncio [] []
queue [] []
spawn [] []
distutils.command.build [] []
setuptools.command._requirestxt [] []
setuptools._vendor.platformdirs.macos [] []
_imp [] []
cmd [] []
setuptools._vendor.wheel.macosx_libfile [] []
typing_extensions [] []
tomllib [] []
setuptools._vendor.packaging.metadata [] []
setuptools._vendor.packaging._manylinux [] []
setuptools.msvc [] []
setuptools._vendor.jaraco.text.show-newlines [] []
_collections [] []
setuptools._vendor.wheel.vendored.packaging.specifiers [] []
setuptools._vendor.importlib_resources [] []
setuptools._vendor.zipp.compat [] []
random [] []
setuptools._vendor.backports.tarfile [] []
tempfile [] []
setuptools.command.egg_info [] []
setuptools._vendor.importlib_resources.abc [] []
setuptools._vendor.typeguard._union_transformer [] []
setuptools._path ['fuzz_config_pyprojecttoml'] []
platformdirs [] []
setuptools._vendor.wheel.cli.pack [] []
setuptools._vendor.autocommand.autoparse [] []
setuptools._vendor.tomli [] []
getpass [] []
setuptools._vendor.wheel.vendored.packaging.version [] []
setuptools._vendor.packaging._structures [] []
_setuptools_logging [] []
setuptools._vendor.importlib_resources.future.adapters [] []
setuptools._distutils.command.sdist [] []
_union_transformer [] []
distutils.util ['fuzz_config_pyprojecttoml'] []
re [] []
setuptools._distutils.command.build_py [] []
setuptools._vendor.backports.tarfile.compat [] []
distutils.command [] []
html [] []
setuptools._importlib [] []
setuptools._vendor.jaraco.functools [] []
setuptools.discovery ['fuzz_config_pyprojecttoml'] []
setuptools._vendor.packaging [] []
_adapters [] []
setuptools._vendor.wheel.vendored.packaging.tags [] []
atheris [] []
setuptools.wheel [] []
setuptools._vendor.importlib_resources._common [] []
posixpath [] []
_common [] []
setuptools._vendor.autocommand.errors [] []
api [] []
Prepared [] []
setuptools.command.alias [] []
setuptools._vendor.typeguard._memo [] []
distutils.command.install_scripts [] []
setuptools._vendor.importlib_metadata.compat.py311 [] []
setuptools.config._validate_pyproject ['fuzz_config_pyprojecttoml'] []
distutils.compat.py39 [] []
setuptools._vendor.jaraco.context [] []
inspect [] []
setuptools._vendor.importlib_metadata._collections [] []
logging [] []
autoparse [] []
setuptools._distutils.command.bdist_rpm [] []
setuptools._distutils._modified [] []
setuptools._vendor.typeguard._checkers [] []
setuptools._vendor.importlib_resources.readers [] []
distutils.archive_util [] []
setuptools._vendor.wheel.__main__ [] []
setuptools._reqs ['fuzz_config_pyprojecttoml'] []
base64 [] []
distutils.versionpredicate [] []
setuptools._vendor.wheel.wheelfile [] []
grp [] []
typing [] []
typeguard [] []
setuptools._distutils.zosccompiler [] []
setuptools.compat.py312 [] []
lzma [] []
setuptools.glob [] []
py_compile [] []
distutils.command.bdist_rpm [] []
setuptools._vendor.more_itertools [] []
setuptools._vendor.platformdirs.__main__ [] []
setuptools._distutils.command [] []
builtins [] []
setuptools._vendor.wheel.vendored.packaging._structures [] []
dis [] []
setuptools._distutils.dir_util [] []
setuptools.compat [] []
setuptools._vendor.platformdirs [] []
setuptools.modified [] []
setuptools._vendor.wheel.bdist_wheel [] []
setuptools.config.setupcfg [] []
setuptools._vendor.typeguard._utils [] []
setuptools._vendor.jaraco.text.to-qwerty [] []
distutils.command.bdist [] []
setuptools._vendor.jaraco.collections [] []
future [] []
abc [] []
Distribution [] []
setuptools._vendor.importlib_resources.functional [] []
setuptools.config._validate_pyproject.fastjsonschema_validations ['fuzz_config_pyprojecttoml'] []
setuptools.version [] []
setuptools._vendor.importlib_metadata._compat [] []
datetime [] []
distutils.sysconfig [] []
distutils.command.install [] []
backports [] []
distutils.log [] []
setuptools._itertools [] []
version [] []
pathlib [] []
unpack [] []
setuptools._vendor.jaraco.text.to-dvorak [] []
setuptools._distutils.file_util [] []
setuptools._distutils.command.build_clib [] []
csv [] []
ssl [] []
marshal [] []
setuptools.command.build_ext [] []
setuptools.command [] []
setuptools._vendor.zipp.glob [] []
convert [] []
time [] []
_aix_support [] []
_transformer [] []
setuptools.command.bdist_rpm [] []
setuptools.config.expand ['fuzz_config_pyprojecttoml'] []
sys [] []
setuptools._vendor.importlib_metadata._meta [] []
setuptools.config._apply_pyprojecttoml ['fuzz_config_pyprojecttoml'] []
file_util [] []
setuptools._distutils.unixccompiler [] []
setuptools._distutils.debug [] []
setuptools._distutils.command.config [] []
pprint [] []
distutils [] []
setuptools._vendor.wheel.vendored.packaging._musllinux [] []
setuptools._distutils.compat [] []
setuptools._imp [] []
threading [] []
setuptools.unicode_utils [] []
setuptools._distutils.command.install_data [] []
jaraco [] []
setuptools.command.bdist_wheel [] []
distutils.command.build_ext [] []
layouts [] []
_log [] []
setuptools._vendor.wheel.vendored.packaging.markers [] []
setuptools._distutils.extension [] []
setuptools.extension [] []
setuptools._vendor.wheel [] []
EntryPoint [] []
setuptools.command.install_scripts [] []
automain [] []
...fuzz_config_pyprojecttoml ['fuzz_config_pyprojecttoml'] []
pickle [] []
setuptools._vendor.packaging._musllinux [] []
setuptools._distutils.archive_util [] []
org [] []
setuptools._vendor.packaging.version [] []
zipimport [] []
setuptools._vendor.wheel.util [] []
sysconfig [] []
concurrent [] []
android [] []
bdist_wheel [] []
distutils.command.install_lib [] []
setuptools._distutils.fancy_getopt [] []
setuptools._distutils._collections [] []
importlib_resources [] []
operator [] []
pwd [] []
setuptools._vendor.importlib_resources._adapters [] []
recipes [] []
textwrap [] []
setuptools._distutils.ccompiler [] []
enum [] []
setuptools._vendor.backports.tarfile.__main__ [] []
setuptools._distutils.command.clean [] []
vendored [] []
setuptools._vendor.wheel.vendored.packaging._elffile [] []
setuptools.command.build_py [] []
setuptools.warnings ['fuzz_config_pyprojecttoml'] []
setuptools._vendor.inflect.compat [] []
setuptools._distutils.command.upload [] []
setuptools._vendor.importlib_resources.future [] []
setuptools._vendor.zipp [] []
setuptools._distutils.command.build_scripts [] []
setuptools._distutils.log [] []
setuptools._vendor.typeguard [] []
setuptools.command.develop [] []
setuptools._vendor.platformdirs.windows [] []
setuptools._distutils.command.bdist [] []
setuptools.logging [] []
setuptools.command.dist_info [] []
tokenize [] []
setuptools._normalization [] []
setuptools._vendor.importlib_metadata._adapters [] []
distutils._itertools [] []
setuptools.command.install_lib [] []
hashlib [] []
setuptools.command.sdist [] []
setuptools._vendor.wheel.vendored.packaging._tokenizer [] []
distutils.compat.py38 [] []
distutils.command.build_clib [] []
setuptools._vendor.autocommand.automain [] []
math [] []
core [] []
setuptools._distutils._msvccompiler [] []
setuptools.windows_support [] []
setuptools._vendor.packaging._tokenizer [] []
setuptools._distutils.command.build [] []
setuptools._vendor.importlib_metadata._itertools [] []
distutils.config [] []
distutils._log [] []
weakref [] []
setuptools._vendor.inflect [] []
setuptools.compat.py310 [] []
inflect [] []
setuptools.command.build_clib [] []
fancy_getopt [] []
setuptools.compat.py39 [] []
email [] []
jnius [] []
ast [] []
wheelfile [] []
setuptools._vendor.packaging.specifiers [] []
zipp [] []
setuptools._vendor.zipp.compat.py310 [] []
setuptools._vendor.importlib_resources.compat [] []
setuptools._vendor.jaraco.text [] []
setuptools._distutils [] []
setuptools.monkey [] []
setuptools._vendor.importlib_metadata._functools [] []
urllib [] []

Directories in report

Directory

Metadata section

This sections shows the raw data that is used to produce this report. This is mainly used for further processing and developer debugging.

Fuzzer Calltree file Program data file Coverage file
fuzz_config_pyprojecttoml fuzzerLogFile-fuzz_config_pyprojecttoml.data fuzzerLogFile-fuzz_config_pyprojecttoml.data.yaml all_cov.json