diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-10-20 21:07:23 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-10-20 21:07:23 +0300 |
| commit | d1031cf49c3b958b915fd558e23453471c29ac33 (patch) | |
| tree | 14fa2bc6d54d5e27bd1e8bfd6fa4dbf894dbe6b9 /examples/batched/batched.cpp | |
| parent | 8cf19d60dc93809db8e51fedc811595eed9134c5 (diff) | |
sampling : refactor init to use llama_sampling_params (#3696)
* sampling : refactor init to use llama_sampling_params
* llama : combine repetition, frequency and presence penalties in 1 call
* examples : remove embd-input and gptneox-wip
* sampling : rename penalty params + reduce size of "prev" vector
* sampling : add llama_sampling_print helper
* sampling : hide prev behind API and apply #3661
ggml-ci
Diffstat (limited to 'examples/batched/batched.cpp')
0 files changed, 0 insertions, 0 deletions