diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2024-01-30 20:17:30 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-30 20:17:30 +0200 |
| commit | e6f291d15844398f8326940fe5ad7f2e02b5aa56 (patch) | |
| tree | 17ba1ea7cdaed162c636752b144247dda0445cba /examples/server/chat.sh | |
| parent | 4003be0e5feef320f3707786f22722b73cff9356 (diff) | |
server : fix context shift (#5195)
* server : fix context shift + simplify self-extend
* server : take system_tokens into account
* server : more n_past fixes
* server : rever n_past_se changes
Diffstat (limited to 'examples/server/chat.sh')
| -rwxr-xr-x | examples/server/chat.sh | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/examples/server/chat.sh b/examples/server/chat.sh index 01436012..da0a6ca6 100755 --- a/examples/server/chat.sh +++ b/examples/server/chat.sh @@ -48,6 +48,7 @@ chat_completion() { top_p: 0.9, n_keep: $n_keep, n_predict: 256, + cache_prompt: true, stop: ["\n### Human:"], stream: true }')" |