Fuzz introspector
For issues and ideas: https://github.com/ossf/fuzz-introspector/issues
Project coverage

Table of contents

Project overview: connexion
High level conclusions
Reachability and coverage overview
Fuzzers overview
Project functions overview
Fuzzer details
Fuzzer: fuzz_query_resolving
Call tree
Fuzz blockers
Runtime coverage analysis
Files reached
Analyses and suggestions
Optimal target analysis
Remaining optimal interesting functions
All functions overview
Runtime coverage analysis
Complex functions with low coverage
Files and Directories in report
Files in report
Directories in report
Metadata section
Function call coverage
Function in each files in report
Report generation date: 2023-03-26

Project overview: connexion

High level conclusions

Reachability and coverage overview

Functions statically reachable by fuzzers
1.16%
32/2748
Cyclomatic complexity statically reachable by fuzzers
1.14%
100/8779
Runtime code coverage of functions
52.0%
1442 / 2748

Fuzzers overview

Fuzzer Fuzzer filename Functions Reached Functions unreached Fuzzer depth Files reached Basic blocks reached Cyclomatic complexity Details
fuzz_query_resolving /src/fuzz_query_resolving.py 33 2786 5 3 13 100 fuzz_query_resolving.py

Project functions overview

The following table shows data about each function in the project. The functions included in this table correspond to all functions that exist in the executables of the fuzzers. As such, there may be functions that are from third-party libraries.

For further technical details on the meaning of columns in the below table, please see the Glossary .

Func name Functions filename Args Function call depth Reached by Fuzzers Fuzzers runtime hit Func lines hit % I Count BB Count Cyclomatic complexity Functions reached Reached by functions Accumulated cyclomatic complexity Undiscovered complexity

Fuzzer details

Fuzzer: fuzz_query_resolving

Call tree

The calltree shows the control flow of the fuzzer. This is overlaid with coverage information to display how much of the potential code a fuzzer can reach is in fact covered at runtime. In the following there is a link to a detailed calltree visualisation as well as a bitmap showing a high-level view of the calltree. For further information about these topics please see the glossary for full calltree and calltree overview

Full calltree

Call tree overview bitmap:

The distribution of callsites in terms of coloring is
Color Runtime hitcount Callsite count Percentage
red 0 57 66.2%
gold [1:9] 0 0.0%
yellow [10:29] 0 0.0%
greenyellow [30:49] 0 0.0%
lawngreen 50+ 29 33.7%
All colors 86 100

Fuzz blockers

The following nodes represent call sites where fuzz blockers occur.

Amount of callsites blocked Calltree index Parent function Callsite Largest blocked function
13 22 werkzeug.datastructures.MultiDict.__init__ call site: 00022 werkzeug.datastructures.CombinedMultiDict.items
12 9 werkzeug.datastructures.MultiDict.lists call site: 00009 werkzeug.datastructures.OrderedMultiDict.lists
8 74 ...fuzz_query_resolving.arbitrary call site: 00074 fdp.ConsumeUnicodeNoSurrogates
4 37 werkzeug.datastructures.MultiDict.__init__ call site: 00037 fdp.ConsumeUnicodeNoSurrogates
4 46 ...fuzz_query_resolving.fixed_params call site: 00046 werkzeug.datastructures.CombinedMultiDict.lists
4 51 ...fuzz_query_resolving.fixed_params call site: 00051 werkzeug.datastructures.CombinedMultiDict.items
4 62 ...fuzz_query_resolving.arbitrary call site: 00062 fdp.ConsumeUnicodeNoSurrogates
4 68 ...fuzz_query_resolving.arbitrary call site: 00068 fdp.ConsumeUnicodeNoSurrogates
2 43 ...fuzz_query_resolving.fixed_params call site: 00043 fdp.ConsumeUnicodeNoSurrogates
1 2 ...fuzz_query_resolving.fixed_params call site: 00002 fdp.PickValueInList
1 6 werkzeug.datastructures.MultiDict.__init__ call site: 00006 werkzeug.datastructures.MultiDict.lists

Runtime coverage analysis

Covered functions
375
Functions that are reachable but not covered
28
Reachable functions
33
Percentage of reachable functions covered
15.15%
NB: The sum of covered functions and functions that are reachable but not covered need not be equal to Reachable functions . This is because the reachability analysis is an approximation and thus at runtime some functions may be covered that are not included in the reachability analysis. This is a limitation of our static analysis capabilities.
Warning: The number of covered functions are larger than the number of reachable functions. This means that there are more functions covered at runtime than are extracted using static analysis. This is likely a result of the static analysis component failing to extract the right call graph or the coverage runtime being compiled with sanitizers in code that the static analysis has not analysed. This can happen if lto/gold is not used in all places that coverage instrumentation is used.
Function name source code lines source lines hit percentage hit

Files reached

filename functions hit
/ 1
...fuzz_query_resolving 9
werkzeug.datastructures 23

Analyses and suggestions

Optimal target analysis

Remaining optimal interesting functions

The following table shows a list of functions that are optimal targets. Optimal targets are identified by finding the functions that in combination, yield a high code coverage.

Func name Functions filename Arg count Args Function depth hitcount instr count bb count cyclomatic complexity Reachable functions Incoming references total cyclomatic complexity Unreached complexity
werkzeug.debug.DebuggedApplication.__call__ werkzeug.debug 3 ['N/A', 'N/A', 'N/A'] 4 0 1 6 5 250 0 826 788
werkzeug.test.Client.resolve_redirect werkzeug.test 3 ['N/A', 'N/A', 'N/A'] 5 0 3 8 6 196 10 655 288
werkzeug.formparser.exhaust_stream.wrapper werkzeug.formparser 4 ['N/A', 'N/A', 'N/A', 'N/A'] 5 0 1 2 4 155 0 508 229
werkzeug.wrappers.response.Response.make_conditional werkzeug.wrappers.response 4 ['N/A', 'N/A', 'N/A', 'N/A'] 4 0 1 6 5 91 0 309 213
werkzeug.serving.run_simple werkzeug.serving 16 ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] 4 0 7 6 5 93 1 299 200
connexion.decorators.parameter.prep_kwargs connexion.decorators.parameter 6 ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] 2 0 1 2 4 44 2 145 130
werkzeug.routing.rules.Rule._compile_builder werkzeug.routing.rules 2 ['N/A', 'N/A'] 2 0 8 8 6 63 4 210 122

Implementing fuzzers that target the above functions will improve reachability such that it becomes:

Functions statically reachable by fuzzers
22.0%
605/2748
Cyclomatic complexity statically reachable by fuzzers
22.9%
2010 / 8779

All functions overview

If you implement fuzzers for these functions, the status of all functions in the project will be:

Func name Functions filename Args Function call depth Reached by Fuzzers Fuzzers runtime hit Func lines hit % I Count BB Count Cyclomatic complexity Functions reached Reached by functions Accumulated cyclomatic complexity Undiscovered complexity

Runtime coverage analysis

This section shows analysis of runtime coverage data.

For futher technical details on how this section is generated, please see the Glossary .

Complex functions with low coverage

Func name Function total lines Lines covered at runtime percentage covered Reached by fuzzers
parser.parse 252 43 17.06% []
app.run 696 207 29.74% []
extensions.setdefault 900 336 37.33% []
part.decode 150 32 21.33% []
collections.abc.Mapping.get 185 52 28.10% []
yaml.load 46 22 47.82% []
d.pop 191 61 31.93% []
loader.get_filename 47 17 36.17% []
werkzeug.serving.WSGIRequestHandler.make_environ 33 0 0.0% []
werkzeug.serving.BaseWSGIServer.__init__ 43 0 0.0% []
o.isoformat 292 144 49.31% []
werkzeug.urls.url_join 40 0 0.0% []
werkzeug.http.parse_options_header 42 5 11.90% []
werkzeug.http.parse_range_header 40 0 0.0% []
werkzeug.http.dump_cookie 39 0 0.0% []
name.replace 72 12 16.66% []
x.project_name.lower 154 45 29.22% []
provider.get_resource_reader 104 31 29.80% []
reader.open_resource 122 17 13.93% []
werkzeug.wsgi.extract_path_info._normalize_netloc 32 2 6.25% []
werkzeug.wsgi.make_line_iter._iter_basic_lines 32 0 0.0% []
werkzeug.wsgi.make_chunk_iter 38 2 5.263% []
werkzeug.utils.send_file 81 0 0.0% []
time.sleep 494 179 36.23% []
headers.get 99 31 31.31% []
re.findall 37 13 35.13% []
werkzeug.wrappers.response.Response.get_wsgi_headers 37 0 0.0% []
werkzeug.test.stream_encode_multipart.write_binary 39 0 0.0% []
werkzeug.test.EnvironBuilder.__init__ 65 0 0.0% []
werkzeug.test.Client.open 34 0 0.0% []
werkzeug.sansio.multipart.MultipartDecoder.next_event 55 0 0.0% []
out.append 68 25 36.76% []
result.extend 170 44 25.88% []
buffer.append 63 16 25.39% []
c.lower 244 57 23.36% []
p.lower 57 21 36.84% []
list.index 145 52 35.86% []
old.lower 256 100 39.06% []
ranges.append 31 7 22.58% []
h.hexdigest 156 42 26.92% []
safe.encode 41 17 41.46% []
url.append 206 54 26.21% []
fields.append 91 21 23.07% []
files.items 121 24 19.83% []
info.strip 37 20 54.05% []
connexion.operations.swagger2.Swagger2Operation._transform_form 35 0 0.0% []
jsonschema.validators.extend 321 109 33.95% []
requests.get 196 68 34.69% []
jsonschema.exceptions.ValidationError 169 69 40.82% []
types.get 416 160 38.46% []
connexion.middleware.security.SecurityOperation._get_verification_fn 65 0 0.0% []
request.scope.get 40 12 30.0% []
werkzeug.routing.matcher.StateMachineMatcher.match._match 73 0 0.0% []
werkzeug.routing.rules.Rule.__init__ 31 0 0.0% []
werkzeug.routing.rules.Rule._parse_rule 52 0 0.0% []
state.static.values 93 43 46.23% []

Files and Directories in report

This section shows which files and directories are considered in this report. The main reason for showing this is fuzz introspector may include more code in the reasoning than is desired. This section helps identify if too many files/directories are included, e.g. third party code, which may be irrelevant for the threat model. In the event too much is included, fuzz introspector supports a configuration file that can exclude data from the report. See the following link for more information on how to create a config file: link

Files in report

Source file Reached by Covered by
[] []
base64 [] []
pkgutil [] []
connexion.frameworks.starlette [] []
connexion.validators.parameter [] []
werkzeug.middleware.profiler [] []
werkzeug.sansio.request [] []
connexion.handlers [] []
ntpath [] []
mimetypes [] []
werkzeug.formparser [] []
connexion.jsonifier [] []
werkzeug.sansio.multipart [] []
connexion.decorators.parameter [] []
werkzeug.debug [] []
operator [] []
werkzeug.wrappers [] []
multipart [] []
hmac [] []
getpass [] []
connexion.middleware.main [] []
unicodedata [] []
werkzeug.routing.map [] []
connexion.apps.flask [] []
connexion.options [] []
codecs [] []
threading [] []
werkzeug._internal [] []
connexion.testing [] []
werkzeug.wrappers.request [] []
httpx [] []
subprocess [] []
connexion.http_facts [] []
werkzeug.http [] []
connexion.exceptions [] []
secrets [] []
werkzeug.debug.tbtools [] []
connexion.middleware.swagger_ui [] []
textwrap [] []
a2wsgi [] []
atheris [] []
werkzeug.utils [] []
connexion.cli [] []
werkzeug.serving [] []
contextlib [] []
hashlib [] []
zlib [] []
connexion.frameworks [] []
http [] []
connexion.problem [] []
ssl [] []
werkzeug.sansio.response [] []
unittest [] []
connexion.middleware.abstract [] []
pathlib [] []
connexion.frameworks.flask [] []
re [] []
connexion.json_schema [] []
functools [] []
werkzeug.middleware.http_proxy [] []
keyword [] []
importlib_metadata [] []
connexion.operations.swagger2 [] []
werkzeug.datastructures ['fuzz_query_resolving'] []
enum [] []
connexion.decorators [] []
connexion.utils [] []
werkzeug.sansio [] []
pstats [] []
ast [] []
winreg [] []
werkzeug.middleware.proxy_fix [] []
termios [] []
signal [] []
pprint [] []
werkzeug.routing.converters [] []
connexion.apps [] []
connexion.validators.abstract [] []
[] []
posixpath [] []
connexion.middleware [] []
copy [] []
fnmatch [] []
werkzeug.wrappers.response [] []
connexion.uri_parsing [] []
connexion.decorators.response [] []
tempfile [] []
typing [] []
asyncio [] []
connexion.lifecycle [] []
inflection [] []
connexion.validators.json [] []
uuid [] []
shutil [] []
connexion.context [] []
werkzeug.middleware.shared_data [] []
markupsafe [] []
werkzeug.wsgi [] []
uvicorn [] []
abc [] []
werkzeug.debug.repr [] []
time [] []
werkzeug.routing.rules [] []
connexion.mock [] []
cryptography [] []
jinja2 [] []
werkzeug.sansio.utils [] []
profile [] []
watchdog [] []
connexion.middleware.routing [] []
connexion.middleware.context [] []
connexion.validators [] []
connexion.spec [] []
warnings [] []
werkzeug.debug.console [] []
contextvars [] []
werkzeug.sansio.http [] []
datetime [] []
atexit [] []
itertools [] []
math [] []
requests [] []
jsonschema [] []
connexion.validators.form_data [] []
dataclasses [] []
werkzeug.middleware.dispatcher [] []
werkzeug._reloader [] []
code [] []
collections [] []
connexion.operations.abstract [] []
connexion.middleware.response_validation [] []
connexion.middleware.request_validation [] []
yaml [] []
connexion.apps.abstract [] []
connexion.middleware.exceptions [] []
werkzeug.security [] []
random [] []
werkzeug.user_agent [] []
werkzeug [] []
socket [] []
flask [] []
sysconfig [] []
connexion.middleware.lifespan [] []
asgiref [] []
werkzeug.exceptions [] []
werkzeug.local [] []
io [] []
logging [] []
string [] []
connexion.apps.asynchronous [] []
starlette [] []
sys [] []
...fuzz_query_resolving ['fuzz_query_resolving'] []
werkzeug.urls [] []
werkzeug.middleware.lint [] []
os [] []
connexion.frameworks.abstract [] []
urllib [] []
pydoc [] []
inspect [] []
connexion.middleware.security [] []
werkzeug.routing.matcher [] []
traceback [] []
linecache [] []
click [] []
werkzeug.test [] []
cProfile [] []
connexion.datastructures [] []
weakref [] []
colorama [] []
connexion.resolver [] []
connexion.decorators.main [] []
werkzeug.routing [] []
connexion [] []
werkzeug.middleware [] []
connexion.security [] []
connexion.__main__ [] []
clickclick [] []
werkzeug.testapp [] []
werkzeug.routing.exceptions [] []
importlib [] []
connexion.operations.openapi [] []
connexion.operations [] []
json [] []

Directories in report

Directory

Metadata section

This sections shows the raw data that is used to produce this report. This is mainly used for further processing and developer debugging.

Fuzzer Calltree file Program data file Coverage file
fuzz_query_resolving fuzzerLogFile-fuzz_query_resolving.data fuzzerLogFile-fuzz_query_resolving.data.yaml all_cov.json

Function call coverage

This section shows a chosen list of functions / methods calls and their relative coverage information. By static analysis of the target project code, all of these function call and their caller information, including the source file or class and line number that initiate the call are captured. Column 1 is the function name of that selected functions or methods. Column 2 of each row indicate if the target function covered by any fuzzer calltree information. Column 3 lists all fuzzers (or no fuzzers at all) that have coered that particular function call dynamically. Column 4 shows list of parent function for the specific function call, while column 5 shows possible blocker functions that make the fuzzers fail to reach the specific functions. Both column 4 and 5 will only show information if none of the fuzzers cover the target function calls.

Function in each files in report

Target sink Callsite location Reached by fuzzer Function call path Covered by fuzzer Possible branch blockers
.exec Not in fuzzer provided call tree []
Parent functions Callpaths
werkzeug.debug.console._InteractiveConsole.runcode
in werkzeug.debug.console:178
Path 1
werkzeug.routing.rules.Rule.refresh
in werkzeug.routing.rules:537 		Path 1
0
Blocker function Arguments type Return type Constants touched
werkzeug.debug.console._InteractiveConsole.runcode
in werkzeug.debug.console:178 		['N/A', 'N/A'] N/A []
werkzeug.routing.rules.Rule.refresh
in werkzeug.routing.rules:537 		['N/A'] N/A []