diff options
| author | Johannes Gäßler <johannesg@5d6.de> | 2024-04-24 11:08:36 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-04-24 11:08:36 +0200 |
| commit | 28103f4832e301a9c84d44ff0df9d75d46ab6c76 (patch) | |
| tree | 8ba391e3a7e0ce9a20d4b41782ef133bd7e32738 /examples/lookup/lookup.cpp | |
| parent | c0d1b3e03e27634ac2871761f5033cf9324d472d (diff) | |
Server: fix seed for multiple slots (#6835)
* Server: add tests for consistent results
* sampling: separate rng per sampling context
Diffstat (limited to 'examples/lookup/lookup.cpp')
| -rw-r--r-- | examples/lookup/lookup.cpp | 1 |
1 files changed, 0 insertions, 1 deletions
diff --git a/examples/lookup/lookup.cpp b/examples/lookup/lookup.cpp index 9526e898..eebbd00a 100644 --- a/examples/lookup/lookup.cpp +++ b/examples/lookup/lookup.cpp @@ -38,7 +38,6 @@ int main(int argc, char ** argv){ // load the model std::tie(model, ctx) = llama_init_from_gpt_params(params); - llama_set_rng_seed(ctx, params.seed); GGML_ASSERT(llama_n_vocab(model) < (1 << 16)); // tokenize the prompt |