diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2025-06-03 17:35:09 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2025-06-03 17:35:09 +0300 |
| commit | f6d5fbdc5780b6dca770c896b8463de3239c7f8b (patch) | |
| tree | 5174cb76b596d23383a4434ab2179d8b5213512f /examples/server | |
| parent | ccb265c01676aad9ae5860ba50e74e61dfcd1cf8 (diff) | |
Adding top-n-sigma sampler (#489)
* Adding top-n-sigma sampler
* Fix typos in XTC PR
* Update README.md for main and server
* More README
* More README
---------
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'examples/server')
| -rw-r--r-- | examples/server/README.md | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/examples/server/README.md b/examples/server/README.md index cb1eb7c9..c5a4b3e7 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -98,6 +98,9 @@ sampling: (default: 0, 0 = disabled, 1 = Mirostat, 2 = Mirostat 2.0) --mirostat-lr N Mirostat learning rate, parameter eta (default: 0.1) --mirostat-ent N Mirostat target entropy, parameter tau (default: 5.0) + --xtc-probability p xtc probability (default: 0.0 => disabled) + --xtc-threshold t xtc threshold (default: 1.0 => disabled) + --top-n-sigma t top-n-sigma parmeter (default: 0.0 => disabled) -l TOKEN_ID(+/-)BIAS modifies the likelihood of token appearing in the completion, i.e. `--logit-bias 15043+1` to increase likelihood of token ' Hello', or `--logit-bias 15043-1` to decrease likelihood of token ' Hello' |