Fuzz blockers

The following nodes represent call sites where fuzz blockers occur.

Amount of callsites blocked	Calltree index	Parent function	Callsite	Largest blocked function
54	8	sacremoses.normalize.MosesPunctNormalizer.__init__	call site: 00008	sacremoses.cli.processor.new_func.processor
9	99	sacremoses.tokenize.MosesDetokenizer.__init__	call site: 00099	sacremoses.cli.detruecase_file
7	91	sacremoses.tokenize.MosesTokenizer.__init__	call site: 00091	sacremoses.cli.detokenize_file
5	71	sacremoses.corpus.NonbreakingPrefixes.words	call site: 00071	sacremoses.tokenize.MosesTokenizer.has_numeric_only
3	63	sacremoses.tokenize.MosesTokenizer.__init__	call site: 00063	sacremoses.corpus.NonbreakingPrefixes.words
2	3	...fuzz_normalizer.TestOneInput	call site: 00003	fdp.ConsumeIntInRange

Fuzzer calltree


         ...fuzz_normalizer.TestOneInput

[function] [call site] 00000


           atheris.FuzzedDataProvider

[function] [call site] 00001


           fdp.ConsumeIntInRange

[function] [call site] 00002


           fdp.ConsumeUnicodeNoSurrogates

[function] [call site] 00003


           fdp.ConsumeIntInRange

[function] [call site] 00004


           fdp.ConsumeUnicodeNoSurrogates

[function] [call site] 00005


           sacremoses.normalize.MosesPunctNormalizer.__init__

[function] [call site] 00006


             itertools.chain

[function] [call site] 00007


             <builtin>.list

[function] [call site] 00008


           sacremoses.cli.processor.new_func.processor

[function] [call site] 00009


             sacremoses.cli.train_truecaser

[function] [call site] 00010


               sacremoses.truecase.MosesTruecaser.__init__

[function] [call site] 00011


                 <builtin>.super

[function] [call site] 00012


                 re.compile

[function] [call site] 00013


                 re.compile

[function] [call site] 00014


                 sacremoses.truecase.MosesTruecaser._load_model

[function] [call site] 00015


                   collections.defaultdict

[function] [call site] 00016


                   io.open

[function] [call site] 00017


                   line.strip

[function] [call site] 00018


                   sacremoses.util.grouper

[function] [call site] 00019


                     <builtin>.iter

[function] [call site] 00020


                     itertools.zip_longest

[function] [call site] 00021


                   count.split

[function] [call site] 00022


                   token.lower

[function] [call site] 00023


                   <builtin>.int

[function] [call site] 00024


                   sacremoses.truecase.MosesTruecaser._casing_to_model

[function] [call site] 00025


                     collections.Counter

[function] [call site] 00026


               sacremoses.truecase.MosesTruecaser.train

[function] [call site] 00027


                 sacremoses.truecase.MosesTruecaser._train

[function] [call site] 00028


                   collections.defaultdict

[function] [call site] 00029


                   functools.partial

[function] [call site] 00030


                   itertools.chain

[function] [call site] 00031


                   sacremoses.util.parallelize_preprocess

[function] [call site] 00032


                     tqdm.tqdm

[function] [call site] 00033


                     <builtin>.map

[function] [call site] 00034


                     joblib.delayed

[function] [call site] 00035


                     joblib.Parallel

[function] [call site] 00036


                   sacremoses.truecase.MosesTruecaser._save_model_from_casing

[function] [call site] 00037


                     io.open

[function] [call site] 00038


                     <builtin>.sum

[function] [call site] 00039


                     <builtin>.enumerate

[function] [call site] 00040


                     tokens_counts.append

[function] [call site] 00041


                     <builtin>.print

[function] [call site] 00042


                   sacremoses.truecase.MosesTruecaser._casing_to_model

[function] [call site] 00043


               sacremoses.truecase.MosesTruecaser.save_model

[function] [call site] 00044


                 sacremoses.truecase.MosesTruecaser._save_model_from_casing

[function] [call site] 00045


             sacremoses.cli.truecase_file

[function] [call site] 00046


               os.path.isfile

[function] [call site] 00047


               copy.deepcopy

[function] [call site] 00048


               sacremoses.truecase.MosesTruecaser.__init__

[function] [call site] 00049


               sacremoses.truecase.MosesTruecaser.train

[function] [call site] 00050


               sacremoses.truecase.MosesTruecaser.save_model

[function] [call site] 00051


               sacremoses.truecase.MosesTruecaser.__init__

[function] [call site] 00052


               functools.partial

[function] [call site] 00053


               sacremoses.cli.parallel_or_not

[function] [call site] 00054


                 functools.partial

[function] [call site] 00055


                 sacremoses.util.parallelize_preprocess

[function] [call site] 00056


             sacremoses.cli.normalize_file

[function] [call site] 00057


               sacremoses.normalize.MosesPunctNormalizer.__init__

[function] [call site] 00058


               functools.partial

[function] [call site] 00059


               sacremoses.cli.parallel_or_not

[function] [call site] 00060


             sacremoses.cli.tokenize_file

[function] [call site] 00061


               sacremoses.tokenize.MosesTokenizer.__init__

[function] [call site] 00062


                 <builtin>.super

[function] [call site] 00063


                 _nbp.strip

[function] [call site] 00064


                 sacremoses.corpus.NonbreakingPrefixes.words

[function] [call site] 00065


                   <builtin>.set

[function] [call site] 00066


                   os.path.join

[function] [call site] 00067


                   pkgutil.get_data

[function] [call site] 00068


                   binary_data.decode

[function] [call site] 00069


                   line.strip

[function] [call site] 00070


                   line.startswith

[function] [call site] 00071


                 <builtin>.open

[function] [call site] 00072


                 line.strip

[function] [call site] 00073


                 line.startswith

[function] [call site] 00074


                 w.rpartition

[function] [call site] 00075


                 sacremoses.tokenize.MosesTokenizer.has_numeric_only

[function] [call site] 00076


                   re.search

[function] [call site] 00077


                   <builtin>.bool

[function] [call site] 00078


                 sacremoses.corpus.Perluniprops.chars

[function] [call site] 00079


                   os.path.join

[function] [call site] 00080


                   pkgutil.get_data

[function] [call site] 00081


                   binary_data.decode

[function] [call site] 00082


                 <builtin>.str

[function] [call site] 00083


                 sacremoses.corpus.Perluniprops.chars

[function] [call site] 00084


                 <builtin>.str

[function] [call site] 00085


                 sacremoses.corpus.Perluniprops.chars

[function] [call site] 00086


                 <builtin>.str

[function] [call site] 00087


                 sacremoses.corpus.Perluniprops.chars

[function] [call site] 00088


                 <builtin>.str

[function] [call site] 00089


                 sacremoses.corpus.Perluniprops.chars

[function] [call site] 00090


                 <builtin>.str

[function] [call site] 00091


               io.open

[function] [call site] 00092


               pattern.strip

[function] [call site] 00093


               fin.readlines

[function] [call site] 00094


               functools.partial

[function] [call site] 00095


               sacremoses.cli.parallel_or_not

[function] [call site] 00096


             sacremoses.cli.detokenize_file

[function] [call site] 00097


               sacremoses.tokenize.MosesDetokenizer.__init__

[function] [call site] 00098


                 <builtin>.super

[function] [call site] 00099


               functools.partial

[function] [call site] 00100


               sacremoses.cli.parallel_or_not

[function] [call site] 00101


               <builtin>.map

[function] [call site] 00102


               <builtin>.list

[function] [call site] 00103


             sacremoses.cli.detruecase_file

[function] [call site] 00104


               sacremoses.truecase.MosesDetruecaser.__init__

[function] [call site] 00105


                 <builtin>.super

[function] [call site] 00106


               functools.partial

[function] [call site] 00107


               sacremoses.cli.parallel_or_not

[function] [call site] 00108