diff options
| author | Alexey Parfenov <zxed@alkatrazstudio.net> | 2024-02-16 11:33:25 +0000 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-02-16 13:33:25 +0200 |
| commit | 6dcc02d2444c779c18d49c364c5d5c5728b6b484 (patch) | |
| tree | 938e984485a0146a61d4254911c308fe83a6c789 /examples/server/README.md | |
| parent | 5f5808ca7b7f23a1fa7a77241842bb84a0e55108 (diff) | |
server : add "samplers" param to control the samplers order (#5494)
Diffstat (limited to 'examples/server/README.md')
| -rw-r--r-- | examples/server/README.md | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/examples/server/README.md b/examples/server/README.md index 8e141d22..24936874 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -204,6 +204,8 @@ node index.js `system_prompt`: Change the system prompt (initial prompt of all slots), this is useful for chat applications. [See more](#change-system-prompt-on-runtime) + `samplers`: The order the samplers should be applied in. An array of strings representing sampler type names. If a sampler is not set, it will not be used. If a sampler is specified more than once, it will be applied multiple times. (default: `["top_k", "tfs_z", "typical_p", "top_p", "min_p", "temperature"]` - these are all the available values) + ### Result JSON - Note: When using streaming mode (`stream`) only `content` and `stop` will be returned until end of completion. |