Fuzz introspector: model_load_fuzzer.cc
For issues and ideas: https://github.com/ossf/fuzz-introspector/issues

Fuzz blockers

The following nodes represent call sites where fuzz blockers occur.

Amount of callsites blocked Calltree index Parent function Callsite Largest blocked function
568 0 EP call site: 00000 sentencepiece::SentencePieceProcessor::DecodeOptimized

Fuzzer calltree

0 LLVMFuzzerTestOneInput [function] [call site] 00000
1 FuzzedDataProvider::ConsumeRandomLengthString [function] [call site] 00001
1 FuzzedDataProvider::ConsumeRemainingBytesAsString [function] [call site] 00002
1 sentencepiece::SentencePieceProcessor::SentencePieceProcessor [function] [call site] 00003
1 sentencepiece::SentencePieceProcessor::LoadFromSerializedProto [function] [call site] 00004
2 std::make_unique<ModelProto> [function] [call site] 00005
2 RET_CHECK [function] [call site] 00006
2 google::protobuf::MessageLite::ParseFromArray [function] [call site] 00007
3 google::protobuf::MessageLite::ParseFrom [function] [call site] 00008
4 internal::MergeFromImpl<alias> [function] [call site] 00010
3 as_string_view [function] [call site] 00011
2 ModelProto::_internal_has_self_test_data [function] [call site] 00012
3 PROTOBUF_ASSUME [function] [call site] 00013
2 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00014
2 sentencepiece::SentencePieceProcessor::Load [function] [call site] 00015
3 std::make_unique<ModelProto> [function] [call site] 00016
3 RETURN_IF_ERROR [function] [call site] 00017
3 sentencepiece::io::LoadModelProto [function] [call site] 00018
4 PyListStringViewVector::empty [function] [call site] 00019
5 PyListStringViewVector::empty [function] [call site] 00020
6 PyListStringViewVector::empty [function] [call site] 00021
4 absl::NotFoundError [function] [call site] 00022
4 sentencepiece::filesystem::NewReadableFile [function] [call site] 00023
5 std::make_unique<DefaultReadableFile> [function] [call site] 00024
4 RETURN_IF_ERROR [function] [call site] 00025
4 sentencepiece::SentencePieceProcessor::status [function] [call site] 00026
5 RET_CHECK [function] [call site] 00027
5 RET_CHECK [function] [call site] 00028
5 RETURN_IF_ERROR [function] [call site] 00029
5 sentencepiece::SentencePieceProcessor::status [function] [call site] 00030
6 RET_CHECK [function] [call site] 00031
6 RET_CHECK [function] [call site] 00032
6 RETURN_IF_ERROR [function] [call site] 00033
6 sentencepiece::SentencePieceProcessor::status [function] [call site] 00034
6 RETURN_IF_ERROR [function] [call site] 00035
6 sentencepiece::SentencePieceProcessor::status [function] [call site] 00036
6 absl::OkStatus [function] [call site] 00037
5 RETURN_IF_ERROR [function] [call site] 00038
5 sentencepiece::SentencePieceProcessor::status [function] [call site] 00039
5 absl::OkStatus [function] [call site] 00040
4 sentencepiece::filesystem::PosixReadableFile::ReadAll [function] [call site] 00041
5 std::string*::assign [function] [call site] 00043
5 std::istreambuf_iterator<char> [function] [call site] 00044
5 std::istreambuf_iterator<char> [function] [call site] 00045
4 absl::InternalError [function] [call site] 00046
4 google::protobuf::StrCat [function] [call site] 00047
5 std::string::resize [function] [call site] 00048
5 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00049
5 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00050
5 std::string::begin [function] [call site] 00051
5 google::protobuf::Append2 [function] [call site] 00052
6 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00053
6 ModelProto::_internal_has_self_test_data [function] [call site] 00055
7 PROTOBUF_ASSUME [function] [call site] 00056
6 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00057
6 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00058
6 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00059
6 ModelProto::_internal_has_self_test_data [function] [call site] 00061
6 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00062
6 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00063
5 GOOGLE_DCHECK_EQ [function] [call site] 00064
5 std::string::size [function] [call site] 00065
4 google::protobuf::MessageLite::ParseFromArray [function] [call site] 00066
5 google::protobuf::MessageLite::ParseFrom [function] [call site] 00067
5 as_string_view [function] [call site] 00068
4 std::string::data [function] [call site] 00069
4 std::string::size [function] [call site] 00070
4 absl::InternalError [function] [call site] 00071
4 google::protobuf::StrCat [function] [call site] 00072
4 absl::OkStatus [function] [call site] 00073
3 PyThreadPool::get [function] [call site] 00074
4 PyThreadPool::get [function] [call site] 00075
5 PyThreadPool::get [function] [call site] 00076
3 sentencepiece::SentencePieceProcessor::Load [function] [call site] 00077
3 std::move [function] [call site] 00078
2 std::move [function] [call site] 00079
1 google::protobuf::Arena::AllocateAlignedNoHook [function] [call site] 00080
2 AllocateAligned [function] [call site] 00081
1 sentencepiece::SentencePieceProcessor::Encode [function] [call site] 00082
2 sentencepiece::SentencePieceProcessor::EncodeOptimized [function] [call site] 00083
3 RET_CHECK_STATUS_STL [function] [call site] 00084
3 PyListStringViewVector::empty [function] [call site] 00085
3 std::vector<T>*::clear [function] [call site] 00086
3 sentencepiece::SentencePieceProcessor::ApplyExtraOptions [function] [call site] 00087
4 std::reverse [function] [call site] 00088
4 SentencePieceText::mutable_pieces [function] [call site] 00089
4 SentencePieceText::mutable_pieces [function] [call site] 00091
4 std::reverse [function] [call site] 00092
4 SentencePieceText_SentencePiece::_internal_has_begin [function] [call site] 00093
4 SentencePieceText_SentencePiece::_internal_has_end [function] [call site] 00094
4 sentencepiece::SentencePieceProcessor::eos_id [function] [call site] 00095
4 SentencePieceText::_internal_add_pieces [function] [call site] 00096
4 SentencePieceText_SentencePiece::_internal_set_id [function] [call site] 00098
4 SentencePieceText_SentencePiece::set_piece [function] [call site] 00099
5 SentencePieceText_SentencePiece::_internal_set_piece [function] [call site] 00100
4 eos_piece [function] [call site] 00103
4 eos_piece [function] [call site] 00104
4 SentencePieceText_SentencePiece::_internal_set_begin [function] [call site] 00105
4 SentencePieceText::_internal_has_text [function] [call site] 00106
4 SentencePieceText_SentencePiece::_internal_set_end [function] [call site] 00107
4 SentencePieceText::_internal_has_text [function] [call site] 00108
4 T*::emplace_back [function] [call site] 00109
4 T*::emplace_back [function] [call site] 00110
4 eos_piece [function] [call site] 00111
4 sentencepiece::SentencePieceProcessor::bos_id [function] [call site] 00112
4 SentencePieceText::mutable_pieces [function] [call site] 00113
4 sentencepiece::random::ReservoirSampler::Add [function] [call site] 00114
5 push_back [function] [call site] 00116
5 absl::Uniform<uint64_t> [function] [call site] 00117
4 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00119
4 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00120
5 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00121
6 PROTOBUF_PREDICT_FALSE [function] [call site] 00122
6 google::protobuf::internal::ExtensionSet::FindOrNullInLargeMap [function] [call site] 00124
7 google::protobuf::StringPiece::find [function] [call site] 00127
8 static_cast<size_type> [function] [call site] 00128
8 std::search [function] [call site] 00129
7 SentencePieceText_SentencePiece::_internal_has_end [function] [call site] 00130
6 std::lower_bound [function] [call site] 00132
6 flat_begin [function] [call site] 00133
6 KeyValue::FirstComparator [function] [call site] 00134
5 GOOGLE_CHECK [function] [call site] 00135
5 GOOGLE_DCHECK [function] [call site] 00136
5 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00138
6 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00139
6 GOOGLE_CHECK [function] [call site] 00140
6 GOOGLE_DCHECK [function] [call site] 00141
6 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00143
6 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00144
7 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00145
7 GOOGLE_CHECK [function] [call site] 00146
7 GOOGLE_DCHECK [function] [call site] 00147
7 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00149
7 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00150
7 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00151
8 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00152
8 GOOGLE_CHECK [function] [call site] 00153
8 GOOGLE_DCHECK [function] [call site] 00154
8 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00156
8 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00157
8 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00158
8 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00159
9 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00160
9 GOOGLE_CHECK [function] [call site] 00161
9 GOOGLE_DCHECK [function] [call site] 00162
9 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00164
9 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00165
9 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00166
9 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00167
9 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00168
10 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00169
10 GOOGLE_CHECK [function] [call site] 00170
10 GOOGLE_DCHECK [function] [call site] 00171
10 cpp_type [function] [call site] 00172
10 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00173
10 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00174
10 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00175
10 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00176
10 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00177
10 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00178
11 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00179
11 GOOGLE_CHECK [function] [call site] 00180
11 GOOGLE_DCHECK [function] [call site] 00181
11 cpp_type [function] [call site] 00182
11 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00183
11 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00184
11 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00185
11 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00186
11 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00187
11 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00188
11 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00189
12 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00190
12 GOOGLE_CHECK [function] [call site] 00191
12 GOOGLE_DCHECK [function] [call site] 00192
12 cpp_type [function] [call site] 00193
12 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00194
12 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00195
12 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00196
12 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00197
12 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00198
12 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00199
12 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00200
12 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00201
13 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00202
13 GOOGLE_CHECK [function] [call site] 00203
13 GOOGLE_DCHECK [function] [call site] 00204
13 cpp_type [function] [call site] 00205
13 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00206
13 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00207
13 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00208
13 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00209
13 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00210
13 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00211
13 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00212
13 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00213
13 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00214
14 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00215
14 GOOGLE_CHECK [function] [call site] 00216
14 GOOGLE_DCHECK [function] [call site] 00217
14 cpp_type [function] [call site] 00218
14 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00219
14 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00220
14 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00221
14 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00222
14 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00223
14 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00224
14 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00225
14 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00226
14 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00227
14 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00228
15 google::protobuf::internal::ExtensionSet::FindOrNull [function] [call site] 00229
15 GOOGLE_CHECK [function] [call site] 00230
15 GOOGLE_DCHECK [function] [call site] 00231
15 cpp_type [function] [call site] 00232
15 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00233
15 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00234
15 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00235
15 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00236
15 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00237
15 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00238
15 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00239
15 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00240
15 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00241
15 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00242
13 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00243
12 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00244
12 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00245
11 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00246
11 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00247
11 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00248
10 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00249
10 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00250
10 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00251
10 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00252
9 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00253
9 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00254
9 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00255
9 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00256
9 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00257
8 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00258
8 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00259
8 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00260
8 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00261
8 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00262
8 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00263
7 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00264
7 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00265
7 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00266
7 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00267
7 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00268
7 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00269
7 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00270
6 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00271
6 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00272
6 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00273
6 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00274
6 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00275
6 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00276
6 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00277
6 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00278
5 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00279
5 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00280
5 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00281
5 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00282
5 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00283
5 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00284
5 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00285
5 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00286
5 google::protobuf::internal::ExtensionSet::SwapElements [function] [call site] 00287
4 google::protobuf::internal::ArenaStringPtr::Mutable [function] [call site] 00288
5 IsDonatedString [function] [call site] 00289
5 IsDefault [function] [call site] 00290
5 GetEmptyStringAlreadyInited [function] [call site] 00291
5 google::protobuf::internal::ArenaStringPtr::UnsafeMutablePointer [function] [call site] 00292
6 GOOGLE_DCHECK [function] [call site] 00293
6 GOOGLE_DCHECK [function] [call site] 00295
6 UnsafeGet [function] [call site] 00296
6 UnsafeGet [function] [call site] 00297
5 google::protobuf::internal::ArenaStringPtr::MutableSlow [function] [call site] 00298
6 GetEmptyStringAlreadyInited [function] [call site] 00299
6 GOOGLE_DCHECK [function] [call site] 00300
6 IsDefault [function] [call site] 00301
6 Arena::Create<std::string> [function] [call site] 00302
6 google::protobuf::internal::ArenaStringPtr::Set [function] [call site] 00304
7 IsDefault [function] [call site] 00305
7 google::protobuf::internal::ArenaStringPtr::Set [function] [call site] 00306
7 Arena::Create<std::string> [function] [call site] 00307
7 google::protobuf::internal::ArenaStringPtr::UnsafeMutablePointer [function] [call site] 00308
7 ModelProto::_internal_has_self_test_data [function] [call site] 00309
8 PROTOBUF_ASSUME [function] [call site] 00310
7 TrainerSpec::_internal_has_max_sentence_length [function] [call site] 00311
4 SentencePieceText_SentencePiece::_internal_set_id [function] [call site] 00312
4 SentencePieceText_SentencePiece::set_piece [function] [call site] 00313
4 bos_piece [function] [call site] 00314
4 bos_piece [function] [call site] 00315
4 SentencePieceText_SentencePiece::_internal_set_begin [function] [call site] 00316
4 SentencePieceText_SentencePiece::_internal_set_end [function] [call site] 00317
4 T*::emplace [function] [call site] 00318
4 SentencePieceText_SentencePiece::_internal_has_begin [function] [call site] 00319
4 T*::emplace [function] [call site] 00320
4 SentencePieceText_SentencePiece::_internal_has_begin [function] [call site] 00321
4 bos_piece [function] [call site] 00322
4 SentencePieceText::_internal_pieces_size [function] [call site] 00323
4 SentencePieceText::mutable_pieces [function] [call site] 00325
4 sentencepiece::SentencePieceProcessor::IsUnknown [function] [call site] 00326
5 RET_CHECK_OR_RETURN_DEFAULT [function] [call site] 00327
5 sentencepiece::SentencePieceProcessor::IsUnknown [function] [call site] 00328
4 sentencepiece::string_util::IsStructurallyValid [function] [call site] 00329
5 ModelProto::_internal_has_self_test_data [function] [call site] 00330
5 ModelProto::_internal_has_self_test_data [function] [call site] 00331
5 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00332
5 sentencepiece::string_util::DecodeUTF8 [function] [call site] 00333
6 static_cast<unsigned [call site] 00334
6 static_cast<unsigned [call site] 00335
6 sentencepiece::string_util::IsTrailByte [function] [call site] 00336
7 static_cast<signed [call site] 00337
6 sentencepiece::string_util::IsValidCodepoint [function] [call site] 00338
7 static_cast<uint32_t> [function] [call site] 00339
6 sentencepiece::string_util::IsTrailByte [function] [call site] 00340
6 sentencepiece::string_util::IsTrailByte [function] [call site] 00341
6 sentencepiece::string_util::IsValidCodepoint [function] [call site] 00342
6 sentencepiece::string_util::IsTrailByte [function] [call site] 00343
6 sentencepiece::string_util::IsTrailByte [function] [call site] 00344
6 sentencepiece::string_util::IsTrailByte [function] [call site] 00345
6 sentencepiece::string_util::IsValidCodepoint [function] [call site] 00346
5 sentencepiece::string_util::IsValidCodepoint [function] [call site] 00347
4 SentencePieceText_SentencePiece::set_piece [function] [call site] 00348
4 unk_piece [function] [call site] 00349
4 unk_piece [function] [call site] 00350
4 sentencepiece::unigram::Lattice::Clear [function] [call site] 00351
5 google::protobuf::as_string_view [function] [call site] 00354
6 google::protobuf::StringPiece [function] [call site] 00355
7 static_cast<size_t> [function] [call site] 00356
7 std::numeric_limits<stringpiece_ssize_type>::max [function] [call site] 00357
7 LogFatalSizeTooBig [function] [call site] 00358
7 static_cast<stringpiece_ssize_type> [function] [call site] 00359
7 google::protobuf::StringPiece [function] [call site] 00360
7 google::protobuf::CheckedSsizeTFromSizeT [function] [call site] 00363
8 static_cast<size_t> [function] [call site] 00364
8 std::numeric_limits<stringpiece_ssize_type>::max [function] [call site] 00365
8 LogFatalSizeTooBig [function] [call site] 00366
8 static_cast<stringpiece_ssize_type> [function] [call site] 00367
7 google::protobuf::data [function] [call site] 00369
7 google::protobuf::CheckedSsizeTFromSizeT [function] [call site] 00370
7 google::protobuf::size [function] [call site] 00371
7 google::protobuf::CheckedSsizeTFromSizeT [function] [call site] 00374
7 reinterpret_cast<const [call site] 00376
7 static_cast<size_t> [function] [call site] 00382
7 google::protobuf::ToString [function] [call site] 00383
8 std::string [function] [call site] 00384
8 google::protobuf::data [function] [call site] 00385
8 static_cast<size_type> [function] [call site] 00386
8 google::protobuf::size [function] [call site] 00387
7 std::string [function] [call site] 00388
7 google::protobuf::data [function] [call site] 00389
7 static_cast<size_type> [function] [call site] 00390
7 google::protobuf::size [function] [call site] 00391
7 google::protobuf::ToString [function] [call site] 00392
7 static_cast<size_t> [function] [call site] 00394
7 static_cast<size_t> [function] [call site] 00396
7 const_reverse_iterator [function] [call site] 00397
7 const_reverse_iterator [function] [call site] 00398
6 static_cast<const [call site] 00401
4 Darts::DoubleArrayImpl::clear [function] [call site] 00404
4 absl::InternalError [function] [call site] 00405
4 absl::OkStatus [function] [call site] 00406
3 RETURN_IF_ERROR [function] [call site] 00407
3 sentencepiece::SentencePieceProcessor::Normalize [function] [call site] 00408
4 RET_CHECK [function] [call site] 00409
4 sentencepiece::SentencePieceProcessor::Normalize [function] [call site] 00410
3 sentencepiece::SentencePieceProcessor::Encode [function] [call site] 00411
3 ByteFallbackEnabled [function] [call site] 00412
3 sentencepiece::SentencePieceProcessor::HasUnkPieceOption [function] [call site] 00413
3 std::vector<T>*::clear [function] [call site] 00414
3 std::vector<T>*::reserve [function] [call site] 00415
3 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00416
3 RET_CHECK [function] [call site] 00417
3 PyListStringViewVector::empty [function] [call site] 00418
4 PyListStringViewVector::empty [function] [call site] 00419
3 sentencepiece::SentencePieceProcessor::IsControl [function] [call site] 00420
4 RET_CHECK_OR_RETURN_DEFAULT [function] [call site] 00421
4 sentencepiece::SentencePieceProcessor::IsControl [function] [call site] 00422
3 std::vector<T>*::emplace_back [function] [call site] 00423
3 std::vector<T>*::emplace_back [function] [call site] 00424
3 ModelProto::_internal_has_self_test_data [function] [call site] 00425
3 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00426
3 sentencepiece::SentencePieceProcessor::IsUnknown [function] [call site] 00427
3 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00428
3 sentencepiece::SentencePieceProcessor::PieceToId [function] [call site] 00429
4 RET_CHECK_OR_RETURN_DEFAULT [function] [call site] 00430
4 sentencepiece::SentencePieceProcessor::PieceToId [function] [call site] 00431
3 ByteToPiece [function] [call site] 00432
3 static_cast<uint8_t> [function] [call site] 00433
3 std::vector<T>*::emplace_back [function] [call site] 00434
3 std::vector<T>*::emplace_back [function] [call site] 00435
3 ByteToPiece [function] [call site] 00436
3 static_cast<uint8_t> [function] [call site] 00437
3 std::vector<T>*::emplace_back [function] [call site] 00438
3 std::vector<T>*::emplace_back [function] [call site] 00439
3 unk_piece [function] [call site] 00440
3 std::vector<T>*::emplace_back [function] [call site] 00441
3 ModelProto::_internal_has_self_test_data [function] [call site] 00442
3 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00443
3 std::vector<T>*::back [function] [call site] 00444
3 ModelProto::_internal_has_self_test_data [function] [call site] 00445
3 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00446
3 sentencepiece::SentencePieceProcessor::ApplyExtraOptions [function] [call site] 00447
1 sentencepiece::SentencePieceProcessor::Encode [function] [call site] 00448
1 std::vector::empty [function] [call site] 00449
1 sentencepiece::SentencePieceProcessor::Decode [function] [call site] 00450
2 SentencePieceText_SentencePiece::_internal_has_begin [function] [call site] 00451
2 SentencePieceText_SentencePiece::_internal_has_end [function] [call site] 00452
2 sentencepiece::SentencePieceProcessor::DecodeOptimized [function] [call site] 00453
3 RET_CHECK_STATUS_STL [function] [call site] 00454
3 PyListStringViewVector::empty [function] [call site] 00455
4 PyListStringViewVector::empty [function] [call site] 00456
3 absl::OkStatus [function] [call site] 00457
3 std::vector::assign [function] [call site] 00459
3 SentencePieceText_SentencePiece::_internal_has_begin [function] [call site] 00460
3 SentencePieceText_SentencePiece::_internal_has_end [function] [call site] 00461
3 RETURN_IF_ERROR [function] [call site] 00462
3 sentencepiece::SentencePieceProcessor::ApplyExtraOptions [function] [call site] 00463
3 trainer_spec [function] [call site] 00464
3 trainer_spec [function] [call site] 00465
3 std::string::empty [function] [call site] 00466
3 absl::OkStatus [function] [call site] 00467
3 std::string::size [function] [call site] 00468
3 sentencepiece::string_util::IsValidDecodeUTF8 [function] [call site] 00469
4 sentencepiece::string_util::DecodeUTF8 [function] [call site] 00470
3 google::protobuf::as_string_view [function] [call site] 00471
3 RET_CHECK_EQ [function] [call site] 00472
3 google::protobuf::StrAppend [function] [call site] 00473
4 GOOGLE_DCHECK_NO_OVERLAP [function] [call site] 00474
4 std::string*::append [function] [call site] 00475
4 ModelProto::_internal_has_self_test_data [function] [call site] 00476
4 sentencepiece::random::ReservoirSampler::total_size [function] [call site] 00477
3 google::protobuf::as_string_view [function] [call site] 00478
3 google::protobuf::StrAppend [function] [call site] 00479
3 std::string::clear [function] [call site] 00480
3 absl::OkStatus [function] [call site] 00481
3 sentencepiece::SentencePieceProcessor::GetPieceSize [function] [call site] 00482
4 RET_CHECK_OR_RETURN_DEFAULT [function] [call site] 00483
4 sentencepiece::SentencePieceProcessor::GetPieceSize [function] [call site] 00484
3 google::protobuf::util::Status::Status [function] [call site] 00485
3 google::protobuf::StrCat [function] [call site] 00486
3 IdToPiece [function] [call site] 00487
3 sentencepiece::SentencePieceProcessor::PieceToId [function] [call site] 00488
3 sentencepiece::SentencePieceProcessor::IsByte [function] [call site] 00489
4 RET_CHECK_OR_RETURN_DEFAULT [function] [call site] 00490
4 sentencepiece::SentencePieceProcessor::IsByte [function] [call site] 00491
3 PieceToByte [function] [call site] 00492
3 RET_CHECK_LE [function] [call site] 00493
3 std::string::append [function] [call site] 00494
3 RETURN_IF_ERROR [function] [call site] 00495
3 ProcessByteQueue [function] [call site] 00496
3 std::string*::empty [function] [call site] 00497
3 sentencepiece::SentencePieceProcessor::IsControl [function] [call site] 00498
3 normalizer_spec [function] [call site] 00499
3 normalizer_spec [function] [call site] 00500
3 absl::ConsumePrefix [function] [call site] 00501
3 normalizer_spec [function] [call site] 00502
3 sentencepiece::SentencePieceProcessor::IsUnknown [function] [call site] 00503
3 IdToPiece [function] [call site] 00504
3 google::protobuf::StrAppend [function] [call site] 00505
3 google::protobuf::StrAppend [function] [call site] 00506
3 google::protobuf::StrAppend [function] [call site] 00507
3 absl::StrReplaceAll [function] [call site] 00508
3 std::string*::empty [function] [call site] 00509
3 RETURN_IF_ERROR [function] [call site] 00510
3 ProcessByteQueue [function] [call site] 00511
3 sentencepiece::SentencePieceProcessor::Normalize [function] [call site] 00512
3 absl::OkStatus [function] [call site] 00513
1 std::vector::empty [function] [call site] 00514
1 sentencepiece::SentencePieceProcessor::Decode [function] [call site] 00515
1 sentencepiece::SentencePieceProcessor::Normalize [function] [call site] 00516
1 sentencepiece::SentencePieceProcessor::GetPieceSize [function] [call site] 00517
1 sentencepiece::SentencePieceProcessor::SafeIdToPiece [function] [call site] 00518
2 RET_CHECK_OR_RETURN_DEFAULT [function] [call site] 00519
2 sentencepiece::SentencePieceProcessor::GetPieceSize [function] [call site] 00520
2 IdToPiece [function] [call site] 00521
1 sentencepiece::SentencePieceProcessor::PieceToId [function] [call site] 00522
1 sentencepiece::SentencePieceProcessor::GetScore [function] [call site] 00523
2 RET_CHECK_OR_RETURN_DEFAULT [function] [call site] 00524
2 sentencepiece::SentencePieceProcessor::GetScore [function] [call site] 00525
1 sentencepiece::SentencePieceProcessor::IsUnknown [function] [call site] 00526
1 sentencepiece::SentencePieceProcessor::IsControl [function] [call site] 00527
1 sentencepiece::SentencePieceProcessor::IsUnused [function] [call site] 00528
2 RET_CHECK_OR_RETURN_DEFAULT [function] [call site] 00529
2 sentencepiece::SentencePieceProcessor::IsUnused [function] [call site] 00530
1 sentencepiece::SentencePieceProcessor::IsByte [function] [call site] 00531
1 sentencepiece::SentencePieceProcessor::PieceToId [function] [call site] 00532
1 sentencepiece::SentencePieceProcessor::unk_id [function] [call site] 00533
1 sentencepiece::SentencePieceProcessor::bos_id [function] [call site] 00534
1 sentencepiece::SentencePieceProcessor::eos_id [function] [call site] 00535
1 sentencepiece::SentencePieceProcessor::pad_id [function] [call site] 00536
1 sentencepiece::SentencePieceProcessor::NBestEncode [function] [call site] 00537
2 RET_CHECK_STATUS_STL [function] [call site] 00538
2 Arena::Create<NBestSentencePieceText> [function] [call site] 00539
2 RETURN_IF_ERROR [function] [call site] 00540
2 sentencepiece::SentencePieceProcessor::NBestEncode [function] [call site] 00541
2 std::vector<std::vector<std::string>>*::reserve [function] [call site] 00542
2 NBestSentencePieceText::clear_nbests [function] [call site] 00543
2 NBestSentencePieceText::clear_nbests [function] [call site] 00545
2 std::vector<std::vector<std::string>>*::emplace_back [function] [call site] 00546
2 emplace_back [function] [call site] 00550
2 absl::OkStatus [function] [call site] 00552
1 sentencepiece::SentencePieceProcessor::SampleEncode [function] [call site] 00553
2 RET_CHECK_STATUS_STL [function] [call site] 00554
2 Arena::Create<SentencePieceText> [function] [call site] 00555
2 RETURN_IF_ERROR [function] [call site] 00556
2 sentencepiece::SentencePieceProcessor::SampleEncode [function] [call site] 00557
2 std::vector<std::string>*::reserve [function] [call site] 00558
2 SentencePieceText::clear_pieces [function] [call site] 00559
2 SentencePieceText::clear_pieces [function] [call site] 00561
2 std::vector<std::string>*::emplace_back [function] [call site] 00562
2 absl::OkStatus [function] [call site] 00564
1 sentencepiece::SentencePieceProcessor::EncodeAsSerializedProto [function] [call site] 00565
1 sentencepiece::SentencePieceProcessor::SampleEncodeAsSerializedProto [function] [call site] 00566
1 sentencepiece::SentencePieceProcessor::serialized_model_proto [function] [call site] 00567
2 SerializeAsString [function] [call site] 00568