diff options
| author | Pierrick Hymbert <pierrick.hymbert@gmail.com> | 2024-03-09 10:30:04 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-09 11:30:04 +0200 |
| commit | fd72d2d2a5e79d61ccef6af3d15f16e5e5cbc352 (patch) | |
| tree | 3a8912adc90c34470fa1e3acb6dd861990159ec7 /examples/server-embd.py | |
| parent | c2101a2e909ac7c08976d414e64e96c90ee5fa9e (diff) | |
server: tests: add truncated prompt tests, better kv cache size (#5933)
* server: tests: add truncated prompt tests, better size
* server, tests : update regex
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/server-embd.py')
0 files changed, 0 insertions, 0 deletions