diff options
| author | Johannes Gäßler <johannesg@5d6.de> | 2024-04-24 11:08:36 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-04-24 11:08:36 +0200 |
| commit | 28103f4832e301a9c84d44ff0df9d75d46ab6c76 (patch) | |
| tree | 8ba391e3a7e0ce9a20d4b41782ef133bd7e32738 /common/common.cpp | |
| parent | c0d1b3e03e27634ac2871761f5033cf9324d472d (diff) | |
Server: fix seed for multiple slots (#6835)
* Server: add tests for consistent results
* sampling: separate rng per sampling context
Diffstat (limited to 'common/common.cpp')
| -rw-r--r-- | common/common.cpp | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/common/common.cpp b/common/common.cpp index 06f252ea..a0d1f8d5 100644 --- a/common/common.cpp +++ b/common/common.cpp @@ -242,7 +242,9 @@ bool gpt_params_find_arg(int argc, char ** argv, const std::string & arg, gpt_pa invalid_param = true; return true; } + // This is temporary, in the future the samplign state will be moved fully to llama_sampling_context. params.seed = std::stoul(argv[i]); + sparams.seed = std::stoul(argv[i]); return true; } if (arg == "-t" || arg == "--threads") { |