diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-10-28 14:23:11 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-10-28 14:23:11 +0300 |
| commit | ee1a0ec9cb367ba41d138134795cbbbe93d2bf1c (patch) | |
| tree | 04111cbd66f34c6cc986e70bb47b96b39828e0f2 /examples/quantize/quantize.cpp | |
| parent | 177461104b454163473dced2a5038f4e016cdb7e (diff) | |
llama : add option for greedy sampling with probs (#3813)
* llama : add option for greedy sampling with probs
* llama : add comment about llama_sample_token_greedy() missing probs
* sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs
Diffstat (limited to 'examples/quantize/quantize.cpp')
0 files changed, 0 insertions, 0 deletions