diff options
| author | Marcus Dunn <51931484+MarcusDunn@users.noreply.github.com> | 2023-10-23 12:40:03 -0700 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-10-23 22:40:03 +0300 |
| commit | 5be6c803fa5378f62a1590f3ad8c6b64c7c0c2ce (patch) | |
| tree | 190868e0431070686d797c3c2d86da857b8ba55f /examples/llava | |
| parent | 6336701c9378c23c85d1c0e464b663ca2bbb8e60 (diff) | |
llama : remove token functions with `context` args in favor of `model` (#3720)
* added `llama_model_token_*` variants to all the `llama_token_*` functions.
* added `LLAMA_API`
* formatting
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* removed old `llama_token` functions
* changed 3 more functions to take in model
- `llama_token_get_text`
- `llama_token_get_score`
- `llama_token_get_type`
* added back docs
* fixed main.cpp
* changed token functions to use new model variants
* changed token functions to use new model variants
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/llava')
| -rw-r--r-- | examples/llava/llava-utils.h | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/examples/llava/llava-utils.h b/examples/llava/llava-utils.h index 45b2b1ad..320c7196 100644 --- a/examples/llava/llava-utils.h +++ b/examples/llava/llava-utils.h @@ -137,7 +137,7 @@ inline llama_token sample_id(llama_context * ctx_llama, gpt_params & params) { inline const char * sample(struct llama_context * ctx_llama, gpt_params & params, int * n_past) { int id = sample_id(ctx_llama, params); static std::string ret; - if (id == llama_token_eos(ctx_llama)) { + if (id == llama_token_eos(llama_get_model(ctx_llama))) { ret = "</s>"; } else { ret = llama_token_to_piece(ctx_llama, id); |