diff options
| author | Michael Coppola <m18coppola@gmail.com> | 2024-02-06 04:20:00 -0500 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-02-06 11:20:00 +0200 |
| commit | 31e790322133a4b1d0684527ea446e765e8a96cf (patch) | |
| tree | 25aa755faa0e373cea32db9a19927b3237fad078 /examples/server/README.md | |
| parent | 4ffc7a17d4e80c5f3f905139cb570ed9b6934fcb (diff) | |
server : add `dynatemp_range` and `dynatemp_exponent` (#5352)
* server: added `dynatemp_range` and `dynatemp_exponent`
* Update README.md
---------
Co-authored-by: Michael Coppola <info@michaeljcoppola.com>
Diffstat (limited to 'examples/server/README.md')
| -rw-r--r-- | examples/server/README.md | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/examples/server/README.md b/examples/server/README.md index d8e7c313..46d8f85a 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -137,6 +137,10 @@ node index.js `temperature`: Adjust the randomness of the generated text (default: 0.8). + `dynatemp_range`: Dynamic temperature range (default: 0.0, 0.0 = disabled). + + `dynatemp_exponent`: Dynamic temperature exponent (default: 1.0). + `top_k`: Limit the next token selection to the K most probable tokens (default: 40). `top_p`: Limit the next token selection to a subset of tokens with a cumulative probability above a threshold P (default: 0.95). |