Fuzz introspector: fuzz_grammar
For issues and ideas: https://github.com/ossf/fuzz-introspector/issues

Fuzz blockers

The following nodes represent call sites where fuzz blockers occur.

Amount of callsites blocked Calltree index Parent function Callsite Largest blocked function
378 72 parse_token(llama_vocab const*, char const*) call site: 00072 ggml_abort
5 38 parse_char(char const*) call site: 00038 __cxa_allocate_exception
5 50 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string , std::__1::allocator > const&, std::__1::vector >&, bool) call site: 00050 __cxa_allocate_exception
4 33 parse_char(char const*) call site: 00033 __cxa_allocate_exception
4 468 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string , std::__1::allocator > const&, std::__1::vector >&, bool) call site: 00468 __cxa_allocate_exception
4 480 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string , std::__1::allocator > const&, std::__1::vector >&, bool) call site: 00480 __cxa_allocate_exception
1 26 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string , std::__1::allocator > const&, std::__1::vector >&, bool) call site: 00026
1 498 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string , std::__1::allocator > const&, std::__1::vector >&, bool) call site: 00498

Fuzzer calltree

0 LLVMFuzzerTestOneInput [function] [call site] 00000
1 llama_grammar_parser::llama_grammar_parser(llama_vocab const*) [function] [call site] 00001
1 llama_grammar_parser::parse(char const*) [function] [call site] 00002
2 parse_space(char const*, bool) [function] [call site] 00003
2 llama_grammar_parser::parse_rule(char const*) [function] [call site] 00004
3 parse_name(char const*) [function] [call site] 00005
4 is_word_char(char) [function] [call site] 00006
5 is_digit_char(char) [function] [call site] 00007
4 __cxa_allocate_exception [call site] 00008
4 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00009
4 __cxa_throw [call site] 00010
4 __cxa_free_exception [call site] 00011
3 parse_space(char const*, bool) [function] [call site] 00012
3 llama_grammar_parser::get_symbol_id(char const*, unsigned long) [function] [call site] 00013
3 __cxa_allocate_exception [call site] 00014
3 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00015
3 __cxa_throw [call site] 00016
3 __cxa_free_exception [call site] 00017
3 parse_space(char const*, bool) [function] [call site] 00018
3 llama_grammar_parser::parse_alternates(char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, unsigned int, bool) [function] [call site] 00019
4 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<llama_grammar_element, std::__1::allocator<llama_grammar_element> >&, bool) [function] [call site] 00020
5 __cxa_allocate_exception [call site] 00021
5 std::runtime_error::runtime_error(char const*) [call site] 00022
5 __cxa_throw [call site] 00023
5 std::runtime_error::~runtime_error() [call site] 00024
5 __cxa_free_exception [call site] 00025
5 parse_char(char const*) [function] [call site] 00026
6 parse_hex(char const*, int) [function] [call site] 00027
7 __cxa_allocate_exception [call site] 00028
7 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00029
7 __cxa_throw [call site] 00030
7 __cxa_free_exception [call site] 00031
6 parse_hex(char const*, int) [function] [call site] 00032
6 parse_hex(char const*, int) [function] [call site] 00033
6 __cxa_allocate_exception [call site] 00034
6 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00035
6 __cxa_throw [call site] 00036
6 __cxa_free_exception [call site] 00037
6 decode_utf8(char const*) [function] [call site] 00038
6 __cxa_allocate_exception [call site] 00039
6 std::runtime_error::runtime_error(char const*) [call site] 00040
6 __cxa_throw [call site] 00041
6 std::runtime_error::~runtime_error() [call site] 00042
6 __cxa_free_exception [call site] 00043
5 parse_space(char const*, bool) [function] [call site] 00044
5 __cxa_allocate_exception [call site] 00045
5 std::runtime_error::runtime_error(char const*) [call site] 00046
5 __cxa_throw [call site] 00047
5 std::runtime_error::~runtime_error() [call site] 00048
5 __cxa_free_exception [call site] 00049
5 parse_char(char const*) [function] [call site] 00050
5 __cxa_allocate_exception [call site] 00051
5 std::runtime_error::runtime_error(char const*) [call site] 00052
5 __cxa_throw [call site] 00053
5 std::runtime_error::~runtime_error() [call site] 00054
5 __cxa_free_exception [call site] 00055
5 parse_char(char const*) [function] [call site] 00056
5 parse_space(char const*, bool) [function] [call site] 00057
5 parse_token(llama_vocab const*, char const*) [function] [call site] 00058
6 __cxa_allocate_exception [call site] 00059
6 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00060
6 __cxa_throw [call site] 00061
6 __cxa_free_exception [call site] 00062
6 parse_int(char const*) [function] [call site] 00063
7 is_digit_char(char) [function] [call site] 00064
7 __cxa_allocate_exception [call site] 00065
7 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00066
7 __cxa_throw [call site] 00067
7 __cxa_free_exception [call site] 00068
6 __cxa_allocate_exception [call site] 00069
6 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00070
6 __cxa_throw [call site] 00071
6 __cxa_free_exception [call site] 00072
6 __cxa_allocate_exception [call site] 00073
6 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00074
6 __cxa_throw [call site] 00075
6 __cxa_free_exception [call site] 00076
6 __cxa_allocate_exception [call site] 00077
6 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00078
6 __cxa_throw [call site] 00079
6 __cxa_free_exception [call site] 00080
6 __cxa_allocate_exception [call site] 00081
6 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00082
6 __cxa_throw [call site] 00083
6 __cxa_free_exception [call site] 00084
6 llama_vocab::tokenize(char const*, int, int*, int, bool, bool) const [function] [call site] 00085
7 llama_vocab::tokenize(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, bool, bool) const [function] [call site] 00086
8 llama_vocab::impl::tokenize(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, bool, bool) const [function] [call site] 00087
9 ggml_abort [function] [call site] 00088
10 fflush [call site] 00089
10 snprintf [call site] 00090
10 vsnprintf [call site] 00091
10 fprintf [call site] 00092
10 abort [call site] 00093
9 llama_vocab::impl::tokenizer_st_partition(std::__1::forward_list<fragment_buffer_variant, std::__1::allocator<fragment_buffer_variant> >&, bool) const [function] [call site] 00094
10 llama_vocab::get_token_data(int) const [function] [call site] 00095
11 ggml_abort [function] [call site] 00096
10 isspace [call site] 00097
10 isspace [call site] 00098
9 llama_vocab::impl::get_type() const [function] [call site] 00099
9 llama_escape_whitespace(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&) [function] [call site] 00100
10 replace_all(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00101
9 llm_tokenizer_spm_session::llm_tokenizer_spm_session(llama_vocab const&) [function] [call site] 00102
9 llm_tokenizer_spm_session::tokenize(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<int, std::__1::allocator<int> >&) [function] [call site] 00103
10 unicode_len_utf8(char) [function] [call site] 00104
10 llm_tokenizer_spm_session::try_add_bigram(int, int) [function] [call site] 00105
11 llama_vocab::text_to_token(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) const [function] [call site] 00106
12 ggml_abort [function] [call site] 00107
11 llama_vocab::n_tokens() const [function] [call site] 00108
11 llama_vocab::get_token_data(int) const [function] [call site] 00109
10 llm_tokenizer_spm_session::try_add_bigram(int, int) [function] [call site] 00110
10 llm_tokenizer_spm_session::try_add_bigram(int, int) [function] [call site] 00111
10 llm_tokenizer_spm_session::resegment(llm_symbol&, std::__1::vector<int, std::__1::allocator<int> >&) [function] [call site] 00112
11 llama_vocab::text_to_token(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) const [function] [call site] 00113
11 llama_vocab::byte_to_token(unsigned char) const [function] [call site] 00114
12 llama_vocab::get_type() const [function] [call site] 00115
12 ggml_abort [function] [call site] 00116
12 llama_vocab::get_type() const [function] [call site] 00117
12 unicode_byte_to_utf8(unsigned char) [function] [call site] 00118
13 __cxa_guard_acquire [call site] 00119
13 unicode_byte_to_utf8_map() [function] [call site] 00120
14 unicode_cpt_to_utf8(unsigned int) [function] [call site] 00121
15 __cxa_allocate_exception [call site] 00122
15 std::invalid_argument::invalid_argument[abi:ne220000](char const*) [function] [call site] 00123
16 std::logic_error::logic_error(char const*) [call site] 00124
15 __cxa_throw [call site] 00125
15 __cxa_free_exception [call site] 00126
14 unicode_cpt_to_utf8(unsigned int) [function] [call site] 00127
14 unicode_cpt_to_utf8(unsigned int) [function] [call site] 00128
14 unicode_cpt_to_utf8(unsigned int) [function] [call site] 00129
13 __cxa_atexit [call site] 00130
13 __cxa_guard_release [call site] 00131
13 __cxa_guard_abort [call site] 00132
12 snprintf [call site] 00133
12 ggml_abort [function] [call site] 00134
11 llm_tokenizer_spm_session::resegment(llm_symbol&, std::__1::vector<int, std::__1::allocator<int> >&) [function] [call site] 00135
12 llm_tokenizer_spm_session::resegment(llm_symbol&, std::__1::vector<int, std::__1::allocator<int> >&) [function] [call site] 00136
9 llm_tokenizer_spm_session::~llm_tokenizer_spm_session() [function] [call site] 00137
9 llama_log_internal(ggml_log_level, char const*, ...) [function] [call site] 00138
10 llama_log_internal_v(ggml_log_level, char const*, __va_list_tag*) [function] [call site] 00139
11 vsnprintf [call site] 00140
11 vsnprintf [call site] 00141
9 ggml_abort [function] [call site] 00142
9 llm_tokenizer_bpe_session::llm_tokenizer_bpe_session(llama_vocab const&, llm_tokenizer_bpe const&) [function] [call site] 00143
10 llama_priority_queue<llm_bigram_bpe, std::__1::vector<llm_bigram_bpe, std::__1::allocator<llm_bigram_bpe> >, llm_bigram_bpe::comparator>::llama_priority_queue() [function] [call site] 00144
9 llm_tokenizer_bpe_session::append_bos(std::__1::vector<int, std::__1::allocator<int> >&) const [function] [call site] 00145
10 llama_vocab::get_add_bos() const [function] [call site] 00146
10 llama_vocab::token_bos() const [function] [call site] 00147
10 ggml_abort [function] [call site] 00148
10 llama_vocab::token_bos() const [function] [call site] 00149
9 llm_tokenizer_bpe_session::tokenize(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<int, std::__1::allocator<int> >&) [function] [call site] 00150
10 unicode_regex_split(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&) [function] [call site] 00151
11 __cxa_guard_acquire [call site] 00152
11 __cxa_atexit [call site] 00153
11 __cxa_guard_release [call site] 00154
11 __cxa_guard_acquire [call site] 00155
11 __cxa_atexit [call site] 00156
11 __cxa_guard_release [call site] 00157
11 __cxa_guard_acquire [call site] 00158
11 __cxa_atexit [call site] 00159
11 __cxa_guard_release [call site] 00160
11 unicode_cpts_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00161
12 unicode_cpt_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, unsigned long&) [function] [call site] 00162
13 __cxa_allocate_exception [call site] 00163
13 std::invalid_argument::invalid_argument[abi:ne220000](char const*) [function] [call site] 00164
13 __cxa_throw [call site] 00165
13 std::invalid_argument::~invalid_argument() [call site] 00166
13 __cxa_allocate_exception [call site] 00167
13 std::invalid_argument::invalid_argument[abi:ne220000](char const*) [function] [call site] 00168
13 __cxa_throw [call site] 00169
13 std::invalid_argument::~invalid_argument() [call site] 00170
13 __cxa_allocate_exception [call site] 00171
13 std::invalid_argument::invalid_argument[abi:ne220000](char const*) [function] [call site] 00172
13 __cxa_throw [call site] 00173
13 std::invalid_argument::~invalid_argument() [call site] 00174
13 __cxa_allocate_exception [call site] 00175
13 std::invalid_argument::invalid_argument[abi:ne220000](char const*) [function] [call site] 00176
13 __cxa_throw [call site] 00177
13 std::invalid_argument::~invalid_argument() [call site] 00178
13 __cxa_allocate_exception [call site] 00179
13 std::invalid_argument::invalid_argument[abi:ne220000](char const*) [function] [call site] 00180
13 __cxa_throw [call site] 00181
13 std::invalid_argument::~invalid_argument() [call site] 00182
13 __cxa_free_exception [call site] 00183
12 __cxa_begin_catch [call site] 00184
12 __cxa_end_catch [call site] 00185
12 __clang_call_terminate [call site] 00186
13 __cxa_begin_catch [call site] 00187
11 __cxa_guard_abort [call site] 00188
11 __cxa_guard_abort [call site] 00189
11 __cxa_guard_abort [call site] 00190
11 unicode_cpt_flags_from_cpt(unsigned int) [function] [call site] 00191
12 __cxa_guard_acquire [call site] 00192
12 unicode_cpt_flags::unicode_cpt_flags(unsigned short) [function] [call site] 00193
12 __cxa_guard_release [call site] 00194
12 __cxa_guard_acquire [call site] 00195
12 unicode_cpt_flags_array() [function] [call site] 00196
13 unicode_cpt_flags::unicode_cpt_flags(unsigned short) [function] [call site] 00197
13 unicode_cpt_flags::unicode_cpt_flags(unsigned short) [function] [call site] 00198
12 __cxa_atexit [call site] 00199
12 __cxa_guard_release [call site] 00200
12 __cxa_guard_abort [call site] 00201
11 unicode_cpt_flags::category_flag() const [function] [call site] 00202
12 unicode_cpt_flags::as_uint() const [function] [call site] 00203
11 unicode_cpt_flags::category_flag() const [function] [call site] 00204
11 unicode_regex_split_custom(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&) [function] [call site] 00205
12 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&) [function] [call site] 00206
13 unicode_cpts_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00207
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00208
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00209
14 unicode_cpt_flags_from_cpt(unsigned int) [function] [call site] 00210
14 unicode_cpt_flags::unicode_cpt_flags(unsigned short) [function] [call site] 00211
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00212
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00213
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00214
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00215
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00216
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00217
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00218
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00219
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00220
13 unicode_cpt_flags::as_uint() const [function] [call site] 00221
13 unicode_cpt_flags::as_uint() const [function] [call site] 00222
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00223
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00224
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00225
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00226
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00227
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00228
13 unicode_regex_split_custom_gpt2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00229
12 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&) [function] [call site] 00230
13 unicode_cpts_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00231
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00232
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00233
14 unicode_cpt_flags_from_cpt(unsigned int) [function] [call site] 00234
14 unicode_cpt_flags::unicode_cpt_flags(unsigned short) [function] [call site] 00235
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00236
13 unicode_tolower(unsigned int) [function] [call site] 00237
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00238
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00239
13 unicode_tolower(unsigned int) [function] [call site] 00240
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00241
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00242
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00243
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00244
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00245
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00246
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00247
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00248
13 unicode_cpt_flags::as_uint() const [function] [call site] 00249
13 unicode_cpt_flags::as_uint() const [function] [call site] 00250
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00251
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00252
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00253
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00254
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00255
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00256
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00257
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00258
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00259
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00260
13 unicode_regex_split_custom_llama3(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00261
12 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&) [function] [call site] 00262
13 unicode_cpts_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00263
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00264
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00265
14 unicode_cpt_flags_from_cpt(unsigned int) [function] [call site] 00266
14 unicode_cpt_flags::unicode_cpt_flags(unsigned short) [function] [call site] 00267
13 unicode_cpt_is_han(unsigned int) [function] [call site] 00268
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00269
13 unicode_cpt_is_han(unsigned int) [function] [call site] 00270
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00271
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00272
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00273
13 unicode_cpt_is_han(unsigned int) [function] [call site] 00274
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00275
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00276
13 unicode_cpt_is_han(unsigned int) [function] [call site] 00277
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00278
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00279
13 unicode_cpt_is_han(unsigned int) [function] [call site] 00280
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00281
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00282
13 unicode_cpt_is_han(unsigned int) [function] [call site] 00283
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00284
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00285
13 unicode_tolower(unsigned int) [function] [call site] 00286
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00287
13 unicode_tolower(unsigned int) [function] [call site] 00288
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00289
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00290
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00291
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00292
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00293
13 unicode_cpt_flags::as_uint() const [function] [call site] 00294
13 unicode_cpt_flags::as_uint() const [function] [call site] 00295
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00296
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00297
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00298
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00299
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00300
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00301
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00302
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00303
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00304
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00305
13 unicode_regex_split_custom_kimi_k2(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_2::operator()(unsigned long) const [function] [call site] 00306
12 unicode_regex_split_custom_afmoe(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&) [function] [call site] 00307
13 unicode_cpts_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00308
13 unicode_regex_split_custom_afmoe(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00309
14 unicode_cpt_flags_from_cpt(unsigned int) [function] [call site] 00310
14 unicode_cpt_flags::unicode_cpt_flags(unsigned short) [function] [call site] 00311
13 unicode_regex_split_custom_afmoe(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_0::operator()(unsigned long) const [function] [call site] 00312
13 unicode_regex_split_custom_afmoe(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00313
13 unicode_regex_split_custom_afmoe(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00314
13 unicode_regex_split_custom_afmoe(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&)::$_1::operator()(unsigned long) const [function] [call site] 00315
11 unicode_cpts_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00316
11 unicode_wstring_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00317
11 __cxa_allocate_exception [call site] 00318
11 std::runtime_error::runtime_error(char const*) [call site] 00319
11 __cxa_throw [call site] 00320
11 __cxa_free_exception [call site] 00321
11 unicode_regex_split_stl(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&) [function] [call site] 00322
11 unicode_regex_split_stl(std::__1::basic_string<wchar_t, std::__1::char_traits<wchar_t>, std::__1::allocator<wchar_t> > const&, std::__1::basic_string<wchar_t, std::__1::char_traits<wchar_t>, std::__1::allocator<wchar_t> > const&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&) [function] [call site] 00323
11 unicode_cpt_flags_from_cpt(unsigned int) [function] [call site] 00324
11 __cxa_begin_catch [call site] 00325
11 fprintf [call site] 00326
11 fprintf [call site] 00327
11 __cxa_allocate_exception [call site] 00328
11 std::runtime_error::runtime_error(char const*) [call site] 00329
11 __cxa_throw [call site] 00330
11 __cxa_free_exception [call site] 00331
11 __cxa_end_catch [call site] 00332
11 unicode_byte_encoding_process(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&) [function] [call site] 00333
12 unicode_cpts_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00334
12 unicode_cpt_to_utf8(unsigned int) [function] [call site] 00335
12 unicode_byte_to_utf8(unsigned char) [function] [call site] 00336
11 unicode_cpt_to_utf8(unsigned int) [function] [call site] 00337
11 __clang_call_terminate [call site] 00338
10 llama_priority_queue<llm_bigram_bpe, std::__1::vector<llm_bigram_bpe, std::__1::allocator<llm_bigram_bpe> >, llm_bigram_bpe::comparator>::llama_priority_queue() [function] [call site] 00339
10 llama_priority_queue<llm_bigram_bpe, std::__1::vector<llm_bigram_bpe, std::__1::allocator<llm_bigram_bpe> >, llm_bigram_bpe::comparator>::operator=(llama_priority_queue<llm_bigram_bpe, std::__1::vector<llm_bigram_bpe, std::__1::allocator<llm_bigram_bpe> >, llm_bigram_bpe::comparator>&&) [function] [call site] 00340
10 llama_vocab::get_ignore_merges() const [function] [call site] 00341
10 llama_vocab::text_to_token(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) const [function] [call site] 00342
10 unicode_len_utf8(char) [function] [call site] 00343
10 llm_tokenizer_bpe_session::add_new_bigram(int, int) [function] [call site] 00344
11 llama_vocab::find_bpe_rank(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) const [function] [call site] 00345
12 ggml_abort [function] [call site] 00346
12 ggml_abort [function] [call site] 00347
12 ggml_abort [function] [call site] 00348
12 ggml_abort [function] [call site] 00349
11 llm_bigram_bpe::llm_bigram_bpe() [function] [call site] 00350
11 llm_bigram_bpe::~llm_bigram_bpe() [function] [call site] 00351
10 llama_priority_queue<llm_bigram_bpe, std::__1::vector<llm_bigram_bpe, std::__1::allocator<llm_bigram_bpe> >, llm_bigram_bpe::comparator>::pop_move() [function] [call site] 00352
11 llm_bigram_bpe::llm_bigram_bpe(llm_bigram_bpe&&) [function] [call site] 00353
11 llm_bigram_bpe::~llm_bigram_bpe() [function] [call site] 00354
10 llm_tokenizer_bpe_session::add_new_bigram(int, int) [function] [call site] 00355
10 llm_tokenizer_bpe_session::add_new_bigram(int, int) [function] [call site] 00356
10 llm_bigram_bpe::~llm_bigram_bpe() [function] [call site] 00357
10 llama_vocab::text_to_token(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) const [function] [call site] 00358
10 llama_vocab::text_to_token(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) const [function] [call site] 00359
9 llm_tokenizer_bpe_session::append(int, std::__1::vector<int, std::__1::allocator<int> >&) [function] [call site] 00360
9 llm_tokenizer_bpe_session::append_eos(std::__1::vector<int, std::__1::allocator<int> >&) const [function] [call site] 00361
10 llama_vocab::get_add_eos() const [function] [call site] 00362
10 llama_vocab::token_eos() const [function] [call site] 00363
10 ggml_abort [function] [call site] 00364
10 llama_vocab::token_eos() const [function] [call site] 00365
9 llm_tokenizer_bpe_session::check_double_bos_eos(std::__1::vector<int, std::__1::allocator<int> > const&) const [function] [call site] 00366
10 llama_vocab::get_add_bos() const [function] [call site] 00367
10 llama_vocab::token_bos() const [function] [call site] 00368
10 llama_log_internal(ggml_log_level, char const*, ...) [function] [call site] 00369
10 llama_vocab::get_add_eos() const [function] [call site] 00370
10 llama_vocab::token_eos() const [function] [call site] 00371
10 llama_log_internal(ggml_log_level, char const*, ...) [function] [call site] 00372
9 llm_tokenizer_bpe_session::~llm_tokenizer_bpe_session() [function] [call site] 00373
9 llm_tokenizer_wpm_session::llm_tokenizer_wpm_session(llama_vocab const&) [function] [call site] 00374
9 llm_tokenizer_wpm_session::tokenize(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<int, std::__1::allocator<int> >&) [function] [call site] 00375
10 llm_tokenizer_wpm_session::preprocess(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00376
11 unicode_cpts_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00377
11 unicode_cpts_normalize_nfd(std::__1::vector<unsigned int, std::__1::allocator<unsigned int> > const&) [function] [call site] 00378
11 unicode_cpt_flags_from_cpt(unsigned int) [function] [call site] 00379
11 unicode_tolower(unsigned int) [function] [call site] 00380
11 unicode_cpt_to_utf8(unsigned int) [function] [call site] 00381
11 llm_tokenizer_wpm_session::is_chinese_char(unsigned int) [function] [call site] 00382
10 llama_vocab::max_token_len() const [function] [call site] 00383
10 llama_vocab::text_to_token(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) const [function] [call site] 00384
10 llama_vocab::token_unk() const [function] [call site] 00385
9 ggml_abort [function] [call site] 00386
9 llm_tokenizer_ugm_session::llm_tokenizer_ugm_session(llama_vocab const&, llm_tokenizer_ugm const&) [function] [call site] 00387
9 llm_tokenizer_ugm_session::tokenize(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<int, std::__1::allocator<int> >&) [function] [call site] 00388
10 llm_tokenizer_ugm_session::normalize(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >*) [function] [call site] 00389
11 llama_vocab::get_escape_whitespaces() const [function] [call site] 00390
11 llama_vocab::get_treat_whitespace_as_suffix() const [function] [call site] 00391
11 llama_vocab::get_add_space_prefix() const [function] [call site] 00392
11 llama_vocab::get_treat_whitespace_as_suffix() const [function] [call site] 00393
11 llama_vocab::get_add_space_prefix() const [function] [call site] 00394
11 llama_vocab::get_remove_extra_whitespaces() const [function] [call site] 00395
11 llm_tokenizer_ugm_session::normalize_prefix(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, unsigned long) [function] [call site] 00396
12 naive_trie::get_longest_prefix(char const*, unsigned long, unsigned long) const [function] [call site] 00397
13 naive_trie::get_longest_prefix(char const*, unsigned long, unsigned long) const [function] [call site] 00398
12 llm_tokenizer_ugm_session::xcda_array_view::xcda_array_view(unsigned int const*, unsigned long) [function] [call site] 00399
12 llm_tokenizer_ugm_session::xcda_array_view::get_base(unsigned long) [function] [call site] 00400
13 llm_tokenizer_ugm_session::xcda_array_view::get_node(unsigned long) [function] [call site] 00401
14 __cxa_allocate_exception [call site] 00402
14 std::runtime_error::runtime_error(char const*) [call site] 00403
14 __cxa_throw [call site] 00404
14 std::runtime_error::~runtime_error() [call site] 00405
14 __cxa_free_exception [call site] 00406
12 llm_tokenizer_ugm_session::xcda_array_view::get_lcheck(unsigned long) [function] [call site] 00407
13 llm_tokenizer_ugm_session::xcda_array_view::get_node(unsigned long) [function] [call site] 00408
12 llm_tokenizer_ugm_session::xcda_array_view::get_leaf(unsigned long) [function] [call site] 00409
13 llm_tokenizer_ugm_session::xcda_array_view::get_node(unsigned long) [function] [call site] 00410
12 llm_tokenizer_ugm_session::xcda_array_view::get_base(unsigned long) [function] [call site] 00411
12 llm_tokenizer_ugm_session::xcda_array_view::get_value(unsigned long) [function] [call site] 00412
13 llm_tokenizer_ugm_session::xcda_array_view::get_node(unsigned long) [function] [call site] 00413
12 __cxa_allocate_exception [call site] 00414
12 std::runtime_error::runtime_error(char const*) [call site] 00415
12 __cxa_throw [call site] 00416
12 std::runtime_error::~runtime_error() [call site] 00417
12 __cxa_free_exception [call site] 00418
12 strlen [call site] 00419
12 unicode_cpt_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, unsigned long&) [function] [call site] 00420
12 __cxa_begin_catch [call site] 00421
12 __cxa_end_catch [call site] 00422
10 llama_vocab::token_unk() const [function] [call site] 00423
10 llama_vocab::token_unk() const [function] [call site] 00424
10 unicode_len_utf8(char) [function] [call site] 00425
10 naive_trie::traverse(char) const [function] [call site] 00426
10 llama_vocab::get_token_data(int) const [function] [call site] 00427
10 llama_vocab::is_user_defined(int) const [function] [call site] 00428
11 llama_vocab::impl::is_user_defined(int) const [function] [call site] 00429
12 ggml_abort [function] [call site] 00430
10 naive_trie::traverse(char) const [function] [call site] 00431
10 llama_vocab::token_unk() const [function] [call site] 00432
10 llama_vocab::token_unk() const [function] [call site] 00433
9 llama_log_internal(ggml_log_level, char const*, ...) [function] [call site] 00434
9 ggml_abort [function] [call site] 00435
9 llm_tokenizer_rwkv_session::llm_tokenizer_rwkv_session(llama_vocab const&, llm_tokenizer_rwkv const&) [function] [call site] 00436
9 llm_tokenizer_rwkv_session::tokenize(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<int, std::__1::allocator<int> >&) [function] [call site] 00437
10 naive_trie::traverse(char) const [function] [call site] 00438
10 llama_vocab::token_unk() const [function] [call site] 00439
10 naive_trie::traverse(char) const [function] [call site] 00440
9 llm_tokenizer_plamo2_session::llm_tokenizer_plamo2_session(llm_tokenizer_plamo2 const&) [function] [call site] 00441
9 llm_tokenizer_plamo2_session::tokenize(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<int, std::__1::allocator<int> >&) [function] [call site] 00442
10 llm_tokenizer_plamo2::encode(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) const [function] [call site] 00443
11 unicode_cpts_from_utf8(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00444
9 ggml_abort [function] [call site] 00445
7 llama_log_internal(ggml_log_level, char const*, ...) [function] [call site] 00446
6 __cxa_allocate_exception [call site] 00447
6 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00448
6 __cxa_throw [call site] 00449
6 __cxa_free_exception [call site] 00450
5 parse_space(char const*, bool) [function] [call site] 00451
5 is_word_char(char) [function] [call site] 00452
5 parse_name(char const*) [function] [call site] 00453
5 llama_grammar_parser::get_symbol_id(char const*, unsigned long) [function] [call site] 00454
5 parse_space(char const*, bool) [function] [call site] 00455
5 parse_space(char const*, bool) [function] [call site] 00456
5 llama_grammar_parser::generate_symbol_id(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00457
5 llama_grammar_parser::parse_alternates(char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, unsigned int, bool) [function] [call site] 00458
6 parse_space(char const*, bool) [function] [call site] 00459
6 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<llama_grammar_element, std::__1::allocator<llama_grammar_element> >&, bool) [function] [call site] 00460
7 __cxa_allocate_exception [call site] 00461
7 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00462
7 __cxa_throw [call site] 00463
7 __cxa_free_exception [call site] 00464
7 parse_space(char const*, bool) [function] [call site] 00465
7 parse_space(char const*, bool) [function] [call site] 00466
7 parse_space(char const*, bool) [function] [call site] 00467
7 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<llama_grammar_element, std::__1::allocator<llama_grammar_element> >&, bool)::$_0::operator()(unsigned long, unsigned long) const [function] [call site] 00468
8 __cxa_allocate_exception [call site] 00469
8 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00470
8 __cxa_throw [call site] 00471
8 __cxa_free_exception [call site] 00472
8 llama_grammar_parser::generate_symbol_id(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [function] [call site] 00473
8 llama_grammar_parser::add_rule(unsigned int, std::__1::vector<llama_grammar_element, std::__1::allocator<llama_grammar_element> > const&) [function] [call site] 00474
7 parse_space(char const*, bool) [function] [call site] 00475
7 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<llama_grammar_element, std::__1::allocator<llama_grammar_element> >&, bool)::$_0::operator()(unsigned long, unsigned long) const [function] [call site] 00476
7 parse_space(char const*, bool) [function] [call site] 00477
7 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<llama_grammar_element, std::__1::allocator<llama_grammar_element> >&, bool)::$_0::operator()(unsigned long, unsigned long) const [function] [call site] 00478
7 parse_space(char const*, bool) [function] [call site] 00479
7 is_digit_char(char) [function] [call site] 00480
7 __cxa_allocate_exception [call site] 00481
7 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00482
7 __cxa_throw [call site] 00483
7 __cxa_free_exception [call site] 00484
7 parse_int(char const*) [function] [call site] 00485
7 parse_space(char const*, bool) [function] [call site] 00486
7 parse_space(char const*, bool) [function] [call site] 00487
7 is_digit_char(char) [function] [call site] 00488
7 parse_int(char const*) [function] [call site] 00489
7 parse_space(char const*, bool) [function] [call site] 00490
7 __cxa_allocate_exception [call site] 00491
7 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00492
7 __cxa_throw [call site] 00493
7 __cxa_free_exception [call site] 00494
7 __cxa_allocate_exception [call site] 00495
7 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00496
7 __cxa_throw [call site] 00497
7 __cxa_free_exception [call site] 00498
7 parse_space(char const*, bool) [function] [call site] 00499
7 llama_grammar_parser::parse_sequence(char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::vector<llama_grammar_element, std::__1::allocator<llama_grammar_element> >&, bool)::$_0::operator()(unsigned long, unsigned long) const [function] [call site] 00500
7 __cxa_allocate_exception [call site] 00501
7 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00502
7 __cxa_throw [call site] 00503
7 __cxa_free_exception [call site] 00504
6 llama_grammar_parser::add_rule(unsigned int, std::__1::vector<llama_grammar_element, std::__1::allocator<llama_grammar_element> > const&) [function] [call site] 00505
3 __cxa_allocate_exception [call site] 00506
3 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00507
3 __cxa_throw [call site] 00508
3 __cxa_free_exception [call site] 00509
3 parse_space(char const*, bool) [function] [call site] 00510
2 __cxa_allocate_exception [call site] 00511
2 std::runtime_error::runtime_error(char const*) [call site] 00512
2 __cxa_throw [call site] 00513
2 __cxa_free_exception [call site] 00514
2 __cxa_allocate_exception [call site] 00515
2 std::runtime_error::runtime_error(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) [call site] 00516
2 __cxa_throw [call site] 00517
2 __cxa_free_exception [call site] 00518
2 __cxa_begin_catch [call site] 00519
2 fprintf [call site] 00520
2 __cxa_end_catch [call site] 00521
1 llama_grammar_parser::~llama_grammar_parser() [function] [call site] 00522