Index

Symbols

--api-key command line option --batch-length command line option, [1] --batch-thread-count command line option, [1], [2] --context-length command line option, [1] --disable-flash-attention command line option --frame-per-second command line option --gpu-layers command line option, [1], [2], [3], [4] --greedy command line option --help command line option, [1], [2], [3], [4], [5] --hostname command line option --json-output-path command line option, [1] --markdown-output-path command line option --min-p command line option --n-predict command line option --output-file command line option --penalty-n command line option --penalty-repeat command line option --port command line option --prompt command line option --prompt-file command line option, [1] --prompt-length command line option --query command line option --seperator command line option, [1] --source-file command line option --ssl-key command line option --ssl-public command line option --system command line option --system-prompt-file command line option --temperature command line option --thread-count command line option, [1], [2], [3], [4] --top-k command line option --top-p command line option

--user-count command line option --version command line option, [1], [2], [3], [4], [5] -b command line option, [1] -bt command line option, [1], [2] -c command line option, [1] -dfa command line option -fps command line option -fsys command line option -gl command line option, [1], [2], [3], [4] -gr command line option -h command line option, [1], [2], [3] -jout command line option, [1] -jsdesc command line option -mdout command line option -mp command line option -np command line option -o command line option -p command line option, [1] -pf command line option, [1] -pn command line option -pr command line option, [1] -q command line option -s command line option -sp command line option, [1] -sys command line option -t command line option, [1], [2], [3], [4] -temp command line option -tk command line option -tp command line option -uc command line option -v command line option, [1], [2], [3], [4], [5]

B

begin (C++ function), [1]

C

cbegin (C++ function) cend (C++ function) command line option --api-key --batch-length, [1] --batch-thread-count, [1], [2] --context-length, [1] --disable-flash-attention --frame-per-second --gpu-layers, [1], [2], [3], [4] --greedy --help, [1], [2], [3], [4], [5] --hostname --json-output-path, [1] --markdown-output-path --min-p --n-predict --output-file --penalty-n --penalty-repeat --port --prompt --prompt-file, [1] --prompt-length --query --seperator, [1] --source-file --ssl-key --ssl-public --system --system-prompt-file --temperature --thread-count, [1], [2], [3], [4] --top-k --top-p --user-count --version, [1], [2], [3], [4], [5] -b, [1] -bt, [1], [2] -c, [1] -dfa -fps -fsys -gl, [1], [2], [3], [4] -gr -h, [1], [2], [3] -jout, [1] -jsdesc -mdout -mp -np -o -p, [1] -pf, [1] -pn -pr, [1] -q -s -sp, [1] -sys -t, [1], [2], [3], [4] -temp -tk -tp -uc -v, [1], [2], [3], [4], [5] file_path

crbegin (C++ function) crend (C++ function)

D

declare_lora_adapter (C++ function) declare_lora_remove (C++ function)

destroy (C++ function) destroy_sync (C++ function)

E

end (C++ function), [1]

F

file_path command line option

G

get_architecture (C++ function) get_assistant_end (C++ function) get_assistant_start (C++ function) get_embedding_length (C++ function) get_eot_token (C++ function) get_head_count (C++ function) get_layer_count (C++ function) get_lf_token (C++ function) get_max_embedding_context (C++ function) get_model_name (C++ function) get_occupied_context_size (C++ function)

get_quantization_string (C++ function) get_raw_model (C++ function) get_registered_processors (C++ function) get_size (C++ function) get_special_tokens (C++ function) get_special_tokens_string (C++ function) get_sys_end (C++ function) get_sys_start (C++ function) get_total_context_size (C++ function) get_usr_end (C++ function) get_usr_start (C++ function) get_vocab_count (C++ function)

H

has_lora_adapter (C++ function)

I

InfModelBase::begin (C++ function) InfModelBase::get_model_category (C++ function) InfModelBase::is_initialize_failed (C++ function) InfModelBase::is_initialized (C++ function) InfModelBase::reset_base_signals (C++ function) InfModelBase::signal_destroying (C++ function) InfModelBase::signal_initializing (C++ function) InfModelBase::signal_state_destroying (C++ function) InfModelBase::signal_state_initializing (C++ function)

initialize_model (C++ function) initialize_model_ex (C++ function) initialize_model_ex_sync (C++ function) initialize_model_sync (C++ function) is_available (C++ function) is_embedding_model (C++ function) is_token_control (C++ function) is_token_eof_generation (C++ function) is_token_special (C++ function)

O

on_lora_operate (C++ function)

R

rbegin (C++ function)

register_context_process (C++ function), [1] rend (C++ function)

S

signal_lora_operation (C++ function)

signal_state_lora_operation (C++ function) start_lora_operation (C++ function)

T

tokenize_input (C++ function)

U

update (C++ function)

update_t (C++ function)