diff options
| author | Alexey Parfenov <zxed@alkatrazstudio.net> | 2023-12-23 09:31:49 +0000 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-12-23 11:31:49 +0200 |
| commit | 6123979952385847d8348e295d77d6e01da8aa84 (patch) | |
| tree | 2d536d31ef7e1b6f07468ff6b13710da1fe4f732 /examples/server/README.md | |
| parent | b9ec82d262cb20d7f0a8a1157bfa9aace40e2625 (diff) | |
server : allow to specify custom prompt for penalty calculation (#3727)
Diffstat (limited to 'examples/server/README.md')
| -rw-r--r-- | examples/server/README.md | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/examples/server/README.md b/examples/server/README.md index 0751b961..f1e586a1 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -148,6 +148,8 @@ node index.js `frequency_penalty`: Repeat alpha frequency penalty (default: 0.0, 0.0 = disabled); + `penalty_prompt`: This will replace the `prompt` for the purpose of the penalty evaluation. Can be either `null`, a string or an array of numbers representing tokens (default: `null` = use the original `prompt`). + `mirostat`: Enable Mirostat sampling, controlling perplexity during text generation (default: 0, 0 = disabled, 1 = Mirostat, 2 = Mirostat 2.0). `mirostat_tau`: Set the Mirostat target entropy, parameter tau (default: 5.0). |