diff options
| author | Didzis Gosko <didzis@users.noreply.github.com> | 2023-06-24 11:47:58 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-06-24 11:47:58 +0300 |
| commit | 527b6fba1d237befb324fd846bda7418c0fa394d (patch) | |
| tree | 360b44abac0c9a53739444b8ba9e4ccf903938cd /examples/common.h | |
| parent | d7b7484f74d486f77feb4c0b7af7e1718ed91651 (diff) | |
llama : make model stateless and context stateful (llama_state) (#1797)
* llama : make model stateless and context stateful
* llama : minor cleanup
* llama : update internal API declaration
* Apply suggestions from code review
fix style
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* Missing model memory release
* Fix style
* Add deprecated warning for public API function llama_init_from_file
* Update public API use cases: move away from deprecated llama_init_from_file
* Deprecate public API function llama_apply_lora_from_file
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/common.h')
| -rw-r--r-- | examples/common.h | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/examples/common.h b/examples/common.h index 6c2953cb..71332017 100644 --- a/examples/common.h +++ b/examples/common.h @@ -9,6 +9,7 @@ #include <random> #include <thread> #include <unordered_map> +#include <tuple> #if !defined (_WIN32) #include <stdio.h> @@ -95,7 +96,7 @@ std::vector<llama_token> llama_tokenize(struct llama_context * ctx, const std::s // Model utils // -struct llama_context * llama_init_from_gpt_params(const gpt_params & params); +std::tuple<struct llama_model *, struct llama_context *> llama_init_from_gpt_params(const gpt_params & params); // // Console utils |