diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2024-01-19 10:45:06 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-19 10:45:06 +0200 |
| commit | 8b20858e5e9c44b99b4b31ae9c40b8f20d01d94f (patch) | |
| tree | 79cc6437f87cb32827bca7fca7ac92453506e1d6 /examples/server/api_like_OAI.py | |
| parent | 57e2a7a52a819883f40dada8a2edc24ecf48186b (diff) | |
perplexity : faster Winogrande via batching (#5024)
* perplexity : faster Winogrande via batching
ggml-ci
* perplexity : remove unused function
* perplexity : only tokenize selected tasks for Winogrande
Diffstat (limited to 'examples/server/api_like_OAI.py')
0 files changed, 0 insertions, 0 deletions