Fuzz introspector: fuzz_crawl
For issues and ideas: https://github.com/ossf/fuzz-introspector/issues

Fuzz blockers

The following nodes represent call sites where fuzz blockers occur.

Amount of callsites blocked Calltree index Parent function Callsite Largest blocked function
279 0 EP call site: {node_id} scrapy.crawler.CrawlerRunner.crawl

Fuzzer calltree

0 ...fuzz_crawl.TestOneInput [function] [call site] 00000
1 atheris.FuzzedDataProvider [function] [call site] 00001
1 fdp.ConsumeIntInRange [function] [call site] 00002
1 fdp.ConsumeUnicodeNoSurrogates [function] [call site] 00003
1 scrapy.crawler.CrawlerProcess.__init__ [function] [call site] 00004
2 <builtin>.super [function] [call site] 00005
2 scrapy.utils.log.configure_logging [function] [call site] 00006
3 logging.captureWarnings [function] [call site] 00007
3 twisted.python.log.PythonLoggingObserver [function] [call site] 00008
3 observer.start [function] [call site] 00009
3 logging.config.dictConfig [function] [call site] 00010
3 <builtin>.isinstance [function] [call site] 00011
3 scrapy.settings.Settings.__init__ [function] [call site] 00012
4 <builtin>.super [function] [call site] 00013
4 scrapy.settings.BaseSettings.setmodule [function] [call site] 00014
5 scrapy.settings.BaseSettings._assert_mutability [function] [call site] 00015
5 <builtin>.isinstance [function] [call site] 00016
5 importlib.import_module [function] [call site] 00017
5 <builtin>.dir [function] [call site] 00018
5 key.isupper [function] [call site] 00019
5 <builtin>.getattr [function] [call site] 00020
5 scrapy.settings.BaseSettings.set [function] [call site] 00021
6 scrapy.settings.BaseSettings._assert_mutability [function] [call site] 00022
6 scrapy.settings.get_settings_priority [function] [call site] 00023
7 <builtin>.isinstance [function] [call site] 00024
6 <builtin>.isinstance [function] [call site] 00025
6 scrapy.settings.SettingsAttribute.__init__ [function] [call site] 00026
7 <builtin>.isinstance [function] [call site] 00027
7 scrapy.settings.BaseSettings.maxpriority [function] [call site] 00028
8 <builtin>.len [function] [call site] 00029
8 scrapy.settings.BaseSettings.getpriority [function] [call site] 00030
8 typing.cast [function] [call site] 00031
8 <builtin>.max [function] [call site] 00032
8 scrapy.settings.get_settings_priority [function] [call site] 00033
7 <builtin>.max [function] [call site] 00034
4 <builtin>.isinstance [function] [call site] 00035
4 scrapy.settings.BaseSettings.__init__ [function] [call site] 00036
5 scrapy.settings.BaseSettings.update [function] [call site] 00037
6 scrapy.settings.BaseSettings._assert_mutability [function] [call site] 00038
6 <builtin>.isinstance [function] [call site] 00039
6 json.loads [function] [call site] 00040
6 typing.cast [function] [call site] 00041
6 <builtin>.isinstance [function] [call site] 00042
6 typing.cast.items [function] [call site] 00043
6 typing.cast.getpriority [function] [call site] 00044
6 scrapy.settings.BaseSettings.getpriority [function] [call site] 00045
6 typing.cast [function] [call site] 00046
6 scrapy.settings.BaseSettings.set [function] [call site] 00047
6 typing.cast.items [function] [call site] 00048
6 scrapy.settings.BaseSettings.set [function] [call site] 00049
4 scrapy.settings.BaseSettings.set [function] [call site] 00050
4 scrapy.settings.BaseSettings.update [function] [call site] 00051
3 scrapy.settings.BaseSettings.getbool [function] [call site] 00052
4 scrapy.settings.BaseSettings.get [function] [call site] 00053
4 <builtin>.int [function] [call site] 00054
4 <builtin>.bool [function] [call site] 00055
3 logging.getLogger [function] [call site] 00056
3 scrapy.utils.log.StreamLogger.__init__ [function] [call site] 00057
3 scrapy.utils.log.install_scrapy_root_handler [function] [call site] 00058
4 logging.root.removeHandler [function] [call site] 00059
4 logging.root.setLevel [function] [call site] 00060
4 scrapy.utils.log._get_handler [function] [call site] 00061
5 scrapy.settings.BaseSettings.get [function] [call site] 00062
5 scrapy.settings.BaseSettings.getbool [function] [call site] 00063
5 scrapy.settings.BaseSettings.get [function] [call site] 00064
5 logging.FileHandler [function] [call site] 00065
5 scrapy.settings.BaseSettings.getbool [function] [call site] 00066
5 logging.StreamHandler [function] [call site] 00067
5 logging.NullHandler [function] [call site] 00068
5 logging.Formatter [function] [call site] 00069
5 scrapy.settings.BaseSettings.get [function] [call site] 00070
5 scrapy.settings.BaseSettings.get [function] [call site] 00071
5 handler.setFormatter [function] [call site] 00072
5 scrapy.settings.BaseSettings.get [function] [call site] 00073
5 handler.setLevel [function] [call site] 00074
5 scrapy.settings.BaseSettings.getbool [function] [call site] 00075
5 scrapy.utils.log.TopLevelFormatter.__init__ [function] [call site] 00076
5 handler.addFilter [function] [call site] 00077
4 logging.root.addHandler [function] [call site] 00078
2 scrapy.utils.log.log_scrapy_info [function] [call site] 00079
3 logger.info [function] [call site] 00080
3 scrapy.utils.versions.scrapy_components_versions [function] [call site] 00081
4 <builtin>.map [function] [call site] 00082
4 <builtin>.map [function] [call site] 00083
4 twisted.version.short [function] [call site] 00084
4 sys.version.replace [function] [call site] 00085
4 scrapy.utils.ssl.get_openssl_version [function] [call site] 00086
5 OpenSSL.SSL.SSLeay_version [function] [call site] 00087
5 system_openssl_bytes.decode [function] [call site] 00088
4 platform.platform [function] [call site] 00089
3 logger.info [function] [call site] 00090
1 scrapy.crawler.CrawlerRunner.crawl [function] [call site] 00091
2 <builtin>.isinstance [function] [call site] 00092
2 scrapy.crawler.CrawlerRunner.create_crawler [function] [call site] 00093
3 <builtin>.isinstance [function] [call site] 00094
3 <builtin>.isinstance [function] [call site] 00095
3 scrapy.crawler.CrawlerRunner._create_crawler [function] [call site] 00096
4 <builtin>.isinstance [function] [call site] 00097
4 typing.cast [function] [call site] 00098
4 scrapy.crawler.Crawler.__init__ [function] [call site] 00099
5 <builtin>.isinstance [function] [call site] 00100
5 <builtin>.isinstance [function] [call site] 00101
5 scrapy.settings.Settings.__init__ [function] [call site] 00102
5 scrapy.settings.BaseSettings.copy [function] [call site] 00103
5 scrapy.crawler.Crawler._update_root_log_handler [function] [call site] 00104
6 scrapy.utils.log.get_scrapy_root_handler [function] [call site] 00105
6 scrapy.utils.log.install_scrapy_root_handler [function] [call site] 00106
5 scrapy.addons.AddonManager.__init__ [function] [call site] 00107
5 scrapy.signalmanager.SignalManager.__init__ [function] [call site] 00108
3 scrapy.crawler.CrawlerProcess._create_crawler [function] [call site] 00109
4 <builtin>.isinstance [function] [call site] 00110
4 scrapy.crawler.Crawler.__init__ [function] [call site] 00111
4 typing.cast [function] [call site] 00112
2 scrapy.crawler.CrawlerRunner._crawl [function] [call site] 00113
3 scrapy.crawler.Crawler.crawl [function] [call site] 00114
4 warnings.warn [function] [call site] 00115
4 scrapy.crawler.Crawler._create_spider [function] [call site] 00116
4 scrapy.crawler.Crawler._apply_settings [function] [call site] 00117
5 scrapy.utils.misc.load_object [function] [call site] 00118
6 <builtin>.isinstance [function] [call site] 00119
6 <builtin>.callable [function] [call site] 00120
6 urllib.parse.urlparse.rindex [function] [call site] 00121
6 typing.cast.rindex [function] [call site] 00122
6 importlib.import_module [function] [call site] 00123
6 <builtin>.getattr [function] [call site] 00124
5 typing.cast [function] [call site] 00125
5 urllib.parse.urlparse [function] [call site] 00126
5 scrapy.utils.log.LogCounterHandler.__init__ [function] [call site] 00127
6 <builtin>.super [function] [call site] 00128
5 logging.root.addHandler [function] [call site] 00129
5 scrapy.utils.misc.load_object [function] [call site] 00130
5 lf_cls.from_crawler [function] [call site] 00131
5 scrapy.utils.misc.build_from_crawler [function] [call site] 00132
6 <builtin>.hasattr [function] [call site] 00133
6 objcls.from_crawler [function] [call site] 00134
6 <builtin>.hasattr [function] [call site] 00135
6 objcls.from_settings [function] [call site] 00136
5 scrapy.utils.misc.load_object [function] [call site] 00137
5 scrapy.utils.reactor.install_reactor [function] [call site] 00138
6 scrapy.utils.misc.load_object [function] [call site] 00139
6 scrapy.utils.reactor.set_asyncio_event_loop_policy [function] [call site] 00140
7 scrapy.utils.reactor._get_asyncio_event_loop_policy [function] [call site] 00141
8 asyncio.get_event_loop_policy [function] [call site] 00142
8 <builtin>.isinstance [function] [call site] 00143
8 asyncio.WindowsSelectorEventLoopPolicy [function] [call site] 00144
8 asyncio.set_event_loop_policy [function] [call site] 00145
6 contextlib.suppress [function] [call site] 00146
6 scrapy.utils.reactor.set_asyncio_event_loop [function] [call site] 00147
7 scrapy.utils.misc.load_object [function] [call site] 00148
7 asyncio.set_event_loop [function] [call site] 00149
7 warnings.catch_warnings [function] [call site] 00150
7 warnings.filterwarnings [function] [call site] 00151
7 asyncio.get_event_loop [function] [call site] 00152
7 asyncio.new_event_loop [function] [call site] 00153
7 asyncio.set_event_loop [function] [call site] 00154
6 twisted.internet.asyncioreactor.install [function] [call site] 00155
6 reactor_path.split [function] [call site] 00156
6 scrapy.utils.misc.load_object [function] [call site] 00157
6 contextlib.suppress [function] [call site] 00158
6 typing.cast [function] [call site] 00159
6 urllib.parse.urlparse [function] [call site] 00160
5 scrapy.utils.log.log_reactor_info [function] [call site] 00161
6 logger.debug [function] [call site] 00162
6 <builtin>.isinstance [function] [call site] 00163
6 logger.debug [function] [call site] 00164
5 scrapy.utils.reactor.verify_installed_reactor [function] [call site] 00165
6 scrapy.utils.misc.load_object [function] [call site] 00166
5 scrapy.utils.reactor.is_asyncio_reactor_installed [function] [call site] 00167
6 <builtin>.isinstance [function] [call site] 00168
5 scrapy.utils.reactor.verify_installed_asyncio_event_loop [function] [call site] 00169
6 scrapy.utils.misc.load_object [function] [call site] 00170
6 <builtin>.isinstance [function] [call site] 00171
5 scrapy.middleware.MiddlewareManager.from_crawler [function] [call site] 00172
6 scrapy.middleware.MiddlewareManager.from_settings [function] [call site] 00173
7 scrapy.middleware.MiddlewareManager._get_mwlist_from_settings [function] [call site] 00174
7 scrapy.utils.misc.load_object [function] [call site] 00175
7 scrapy.utils.misc.build_from_crawler [function] [call site] 00176
7 scrapy.utils.misc.build_from_settings [function] [call site] 00177
8 <builtin>.hasattr [function] [call site] 00178
8 objcls.from_settings [function] [call site] 00179
7 middlewares.append [function] [call site] 00180
7 enabled.append [function] [call site] 00181
7 logger.warning [function] [call site] 00182
7 logger.info [function] [call site] 00183
7 scrapy.middleware.MiddlewareManager.__init__ [function] [call site] 00184
8 collections.defaultdict [function] [call site] 00185
8 scrapy.middleware.MiddlewareManager._add_middleware [function] [call site] 00186
9 <builtin>.hasattr [function] [call site] 00187
9 <builtin>.hasattr [function] [call site] 00188
5 scrapy.settings.overridden_settings [function] [call site] 00189
6 scrapy.settings.iter_default_settings [function] [call site] 00190
7 <builtin>.dir [function] [call site] 00191
7 name.isupper [function] [call site] 00192
7 <builtin>.getattr [function] [call site] 00193
6 <builtin>.isinstance [function] [call site] 00194
5 <builtin>.dict [function] [call site] 00195
5 logger.info [function] [call site] 00196
4 scrapy.crawler.Crawler._update_root_log_handler [function] [call site] 00197
4 scrapy.crawler.Crawler._create_engine [function] [call site] 00198
5 scrapy.core.engine.ExecutionEngine.__init__ [function] [call site] 00199
6 scrapy.core.engine.ExecutionEngine._get_scheduler_class [function] [call site] 00200
7 scrapy.utils.misc.load_object [function] [call site] 00201
7 <builtin>.issubclass [function] [call site] 00202
6 scrapy.utils.misc.load_object [function] [call site] 00203
6 scrapy.core.scraper.Scraper.__init__ [function] [call site] 00204
7 scrapy.middleware.MiddlewareManager.from_crawler [function] [call site] 00205
7 scrapy.utils.misc.load_object [function] [call site] 00206
7 itemproc_cls.from_crawler [function] [call site] 00207
7 crawler.settings.getint [function] [call site] 00208
4 <builtin>.iter [function] [call site] 00209
4 scrapy.core.engine.ExecutionEngine.open_spider [function] [call site] 00210
5 logger.info [function] [call site] 00211
5 scrapy.utils.reactor.CallLaterOnce.__init__ [function] [call site] 00212
5 scrapy.utils.misc.build_from_crawler [function] [call site] 00213
5 scrapy.core.engine.Slot.__init__ [function] [call site] 00214
6 <builtin>.set [function] [call site] 00215
6 <builtin>.iter [function] [call site] 00216
6 twisted.internet.task.LoopingCall [function] [call site] 00217
5 <builtin>.hasattr [function] [call site] 00218
5 scheduler.open [function] [call site] 00219
5 scrapy.core.scraper.Scraper.open_spider [function] [call site] 00220
6 scrapy.core.scraper.Slot.__init__ [function] [call site] 00221
7 collections.deque [function] [call site] 00222
7 <builtin>.set [function] [call site] 00223
4 twisted.internet.defer.maybeDeferred [function] [call site] 00224
4 scrapy.core.engine.ExecutionEngine.close [function] [call site] 00225
5 scrapy.core.engine.ExecutionEngine.stop [function] [call site] 00226
6 twisted.internet.defer.inlineCallbacks [function] [call site] 00227
6 scrapy.core.engine.ExecutionEngine.close_spider [function] [call site] 00228
7 logger.info [function] [call site] 00229
7 scrapy.core.engine.Slot.close [function] [call site] 00230
8 twisted.internet.defer.Deferred [function] [call site] 00231
8 scrapy.core.engine.Slot._maybe_fire_closing [function] [call site] 00232
9 twisted.internet.defer.Deferred.callback [function] [call site] 00233
7 twisted.internet.defer.Deferred.addBoth [function] [call site] 00234
7 scrapy.core.engine.ExecutionEngine.close_spider.log_failure [function] [call site] 00235
7 twisted.internet.defer.Deferred.addErrback [function] [call site] 00236
7 twisted.internet.defer.Deferred.addBoth [function] [call site] 00237
7 scrapy.core.engine.ExecutionEngine.close_spider.log_failure [function] [call site] 00238
7 twisted.internet.defer.Deferred.addErrback [function] [call site] 00239
7 <builtin>.hasattr [function] [call site] 00240
7 twisted.internet.defer.Deferred.addBoth [function] [call site] 00241
7 scrapy.core.engine.ExecutionEngine.close_spider.log_failure [function] [call site] 00242
7 twisted.internet.defer.Deferred.addErrback [function] [call site] 00243
7 twisted.internet.defer.Deferred.addBoth [function] [call site] 00244
7 scrapy.core.engine.ExecutionEngine.close_spider.log_failure [function] [call site] 00245
7 twisted.internet.defer.Deferred.addErrback [function] [call site] 00246
7 twisted.internet.defer.Deferred.addBoth [function] [call site] 00247
7 scrapy.core.engine.ExecutionEngine.close_spider.log_failure [function] [call site] 00248
7 twisted.internet.defer.Deferred.addErrback [function] [call site] 00249
7 twisted.internet.defer.Deferred.addBoth [function] [call site] 00250
7 twisted.internet.defer.Deferred.addBoth [function] [call site] 00251
7 scrapy.core.engine.ExecutionEngine.close_spider.log_failure [function] [call site] 00252
7 twisted.internet.defer.Deferred.addErrback [function] [call site] 00253
7 twisted.internet.defer.Deferred.addBoth [function] [call site] 00254
7 scrapy.core.engine.ExecutionEngine.close_spider.log_failure [function] [call site] 00255
7 twisted.internet.defer.Deferred.addErrback [function] [call site] 00256
7 twisted.internet.defer.Deferred.addBoth [function] [call site] 00257
6 twisted.internet.defer.succeed [function] [call site] 00258
6 dfd.addBoth [function] [call site] 00259
5 scrapy.core.engine.ExecutionEngine.close_spider [function] [call site] 00260
5 twisted.internet.defer.succeed [function] [call site] 00261
3 twisted.internet.defer.maybeDeferred.addBoth [function] [call site] 00262
3 twisted.internet.defer.succeed.addBoth [function] [call site] 00263
3 twisted.internet.defer.Deferred.addBoth [function] [call site] 00264
1 scrapy.crawler.CrawlerProcess.start [function] [call site] 00265
2 scrapy.crawler.CrawlerRunner.join [function] [call site] 00266
3 twisted.internet.defer.DeferredList [function] [call site] 00267
2 twisted.internet.defer.DeferredList.addBoth [function] [call site] 00268
2 scrapy.utils.misc.load_object [function] [call site] 00269
2 scrapy.utils.misc.build_from_crawler [function] [call site] 00270
2 resolver.install_on_reactor [function] [call site] 00271
2 twisted.internet.reactor.getThreadPool [function] [call site] 00272
2 scrapy.settings.BaseSettings.getint [function] [call site] 00273
3 scrapy.settings.BaseSettings.get [function] [call site] 00274
3 <builtin>.int [function] [call site] 00275
2 tp.adjustPoolsize [function] [call site] 00276
2 twisted.internet.reactor.addSystemEventTrigger [function] [call site] 00277
2 twisted.internet.reactor.addSystemEventTrigger [function] [call site] 00278
2 twisted.internet.reactor.run [function] [call site] 00279