diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2025-06-03 11:32:03 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2025-06-03 11:32:03 +0300 |
| commit | ccb265c01676aad9ae5860ba50e74e61dfcd1cf8 (patch) | |
| tree | 8e2d9303bd091c4d0015fce8402162346d998cca /src/llama.cpp | |
| parent | 4f8b05a0d76e6c5e47fe1f6c7bd079e0fe95dbba (diff) | |
Adding the XTC sampler (#486)
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'src/llama.cpp')
| -rw-r--r-- | src/llama.cpp | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/src/llama.cpp b/src/llama.cpp index 18c7cd0f..90e342e1 100644 --- a/src/llama.cpp +++ b/src/llama.cpp @@ -23265,6 +23265,11 @@ void llama_sample_temp(struct llama_context * ctx, llama_token_data_array * cand llama_sample_temp_impl(ctx ? &ctx->sampling : nullptr, candidates_p, temp); } +void llama_sample_xtc(struct llama_context * ctx, llama_token_data_array * candidates_p, + float probability, float threshold, size_t min_keep) { + llama_sample_xtc_impl(ctx ? &ctx->sampling : nullptr, candidates_p, probability, threshold, min_keep); +} + void llama_sample_repetition_penalties( struct llama_context * ctx, llama_token_data_array * candidates, |