Fuzz blockers

The following nodes represent call sites where fuzz blockers occur.

Amount of callsites blocked	Calltree index	Parent function	Callsite	Largest blocked function
58	49	sacremoses.tokenize.MosesTokenizer.__init__	call site: 00049	sacremoses.cli.truecase_file
10	10	sacremoses.normalize.MosesPunctNormalizer.__init__	call site: 00010	sacremoses.cli.tokenize_file
5	29	sacremoses.corpus.NonbreakingPrefixes.words	call site: 00029	sacremoses.tokenize.MosesTokenizer.has_numeric_only
3	21	sacremoses.tokenize.MosesTokenizer.__init__	call site: 00021	sacremoses.corpus.NonbreakingPrefixes.words
2	6	...fuzz_detokenize.TestOneInput	call site: 00006	sacremoses.cli.normalize_file

Fuzzer calltree


         ...fuzz_detokenize.TestOneInput

[function] [call site] 00000


           atheris.FuzzedDataProvider

[function] [call site] 00001


           fdp.ConsumeIntInRange

[function] [call site] 00002


           fdp.ConsumeUnicodeNoSurrogates

[function] [call site] 00003


           sacremoses.tokenize.MosesDetokenizer.__init__

[function] [call site] 00004


             <builtin>.super

[function] [call site] 00005


           sacremoses.cli.processor.new_func.processor

[function] [call site] 00006


             sacremoses.cli.normalize_file

[function] [call site] 00007


               sacremoses.normalize.MosesPunctNormalizer.__init__

[function] [call site] 00008


                 itertools.chain

[function] [call site] 00009


                 <builtin>.list

[function] [call site] 00010


               functools.partial

[function] [call site] 00011


               sacremoses.cli.parallel_or_not

[function] [call site] 00012


                 functools.partial

[function] [call site] 00013


                 sacremoses.util.parallelize_preprocess

[function] [call site] 00014


                   tqdm.tqdm

[function] [call site] 00015


                   <builtin>.map

[function] [call site] 00016


                   joblib.delayed

[function] [call site] 00017


                   joblib.Parallel

[function] [call site] 00018


             sacremoses.cli.tokenize_file

[function] [call site] 00019


               sacremoses.tokenize.MosesTokenizer.__init__

[function] [call site] 00020


                 <builtin>.super

[function] [call site] 00021


                 _nbp.strip

[function] [call site] 00022


                 sacremoses.corpus.NonbreakingPrefixes.words

[function] [call site] 00023


                   <builtin>.set

[function] [call site] 00024


                   os.path.join

[function] [call site] 00025


                   pkgutil.get_data

[function] [call site] 00026


                   binary_data.decode

[function] [call site] 00027


                   line.strip

[function] [call site] 00028


                   line.startswith

[function] [call site] 00029


                 <builtin>.open

[function] [call site] 00030


                 line.strip

[function] [call site] 00031


                 line.startswith

[function] [call site] 00032


                 w.rpartition

[function] [call site] 00033


                 sacremoses.tokenize.MosesTokenizer.has_numeric_only

[function] [call site] 00034


                   re.search

[function] [call site] 00035


                   <builtin>.bool

[function] [call site] 00036


                 sacremoses.corpus.Perluniprops.chars

[function] [call site] 00037


                   os.path.join

[function] [call site] 00038


                   pkgutil.get_data

[function] [call site] 00039


                   binary_data.decode

[function] [call site] 00040


                 <builtin>.str

[function] [call site] 00041


                 sacremoses.corpus.Perluniprops.chars

[function] [call site] 00042


                 <builtin>.str

[function] [call site] 00043


                 sacremoses.corpus.Perluniprops.chars

[function] [call site] 00044


                 <builtin>.str

[function] [call site] 00045


                 sacremoses.corpus.Perluniprops.chars

[function] [call site] 00046


                 <builtin>.str

[function] [call site] 00047


                 sacremoses.corpus.Perluniprops.chars

[function] [call site] 00048


                 <builtin>.str

[function] [call site] 00049


               io.open

[function] [call site] 00050


               pattern.strip

[function] [call site] 00051


               fin.readlines

[function] [call site] 00052


               functools.partial

[function] [call site] 00053


               sacremoses.cli.parallel_or_not

[function] [call site] 00054


             sacremoses.cli.train_truecaser

[function] [call site] 00055


               sacremoses.truecase.MosesTruecaser.__init__

[function] [call site] 00056


                 <builtin>.super

[function] [call site] 00057


                 re.compile

[function] [call site] 00058


                 re.compile

[function] [call site] 00059


                 sacremoses.truecase.MosesTruecaser._load_model

[function] [call site] 00060


                   collections.defaultdict

[function] [call site] 00061


                   io.open

[function] [call site] 00062


                   line.strip

[function] [call site] 00063


                   sacremoses.util.grouper

[function] [call site] 00064


                     <builtin>.iter

[function] [call site] 00065


                     itertools.zip_longest

[function] [call site] 00066


                   count.split

[function] [call site] 00067


                   token.lower

[function] [call site] 00068


                   <builtin>.int

[function] [call site] 00069


                   sacremoses.truecase.MosesTruecaser._casing_to_model

[function] [call site] 00070


                     sacremoses.truecase.Counter

[function] [call site] 00071


                     collections.Counter

[function] [call site] 00072


               sacremoses.truecase.MosesTruecaser.train

[function] [call site] 00073


                 sacremoses.truecase.MosesTruecaser._train

[function] [call site] 00074


                   collections.defaultdict

[function] [call site] 00075


                   functools.partial

[function] [call site] 00076


                   itertools.chain

[function] [call site] 00077


                   sacremoses.util.parallelize_preprocess

[function] [call site] 00078


                   sacremoses.truecase.MosesTruecaser._save_model_from_casing

[function] [call site] 00079


                     io.open

[function] [call site] 00080


                     <builtin>.sum

[function] [call site] 00081


                     <builtin>.enumerate

[function] [call site] 00082


                     tokens_counts.append

[function] [call site] 00083


                     <builtin>.print

[function] [call site] 00084


                   sacremoses.truecase.MosesTruecaser._casing_to_model

[function] [call site] 00085


               sacremoses.truecase.MosesTruecaser.save_model

[function] [call site] 00086


                 sacremoses.truecase.MosesTruecaser._save_model_from_casing

[function] [call site] 00087


             sacremoses.cli.detruecase_file

[function] [call site] 00088


               sacremoses.truecase.MosesDetruecaser.__init__

[function] [call site] 00089


                 <builtin>.super

[function] [call site] 00090


               functools.partial

[function] [call site] 00091


               sacremoses.cli.parallel_or_not

[function] [call site] 00092


             sacremoses.cli.detokenize_file

[function] [call site] 00093


               sacremoses.tokenize.MosesDetokenizer.__init__

[function] [call site] 00094


               functools.partial

[function] [call site] 00095


               sacremoses.cli.parallel_or_not

[function] [call site] 00096


               <builtin>.map

[function] [call site] 00097


               <builtin>.list

[function] [call site] 00098


             sacremoses.cli.truecase_file

[function] [call site] 00099


               os.path.isfile

[function] [call site] 00100


               copy.deepcopy

[function] [call site] 00101


               sacremoses.truecase.MosesTruecaser.__init__

[function] [call site] 00102


               sacremoses.truecase.MosesTruecaser.train

[function] [call site] 00103


               sacremoses.truecase.MosesTruecaser.save_model

[function] [call site] 00104


               sacremoses.truecase.MosesTruecaser.__init__

[function] [call site] 00105


               functools.partial

[function] [call site] 00106


               sacremoses.cli.parallel_or_not

[function] [call site] 00107