diff options
| author | Michael Podvitskiy <podvitskiymichael@gmail.com> | 2024-03-02 20:52:25 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-02 21:52:25 +0200 |
| commit | 4a6e2d6142ab815c964924896891e9ab3e050632 (patch) | |
| tree | f131e13286a84b912001d8e56d5b3ce316cf3283 /examples/server/tests/features/environment.py | |
| parent | 494c87032613e31c0be99b2735e732871f2c4e4d (diff) | |
llama : add abort_callback to interrupt computation (#5409)
* using abort_callback from ggml to stop llama computation
* format fix
* a brief explaining comment
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/server/tests/features/environment.py')
0 files changed, 0 insertions, 0 deletions