diff options
| author | Minsoo Cheong <54794500+mscheong01@users.noreply.github.com> | 2024-03-24 17:54:07 +0900 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-24 10:54:07 +0200 |
| commit | 586e7bc561be88e929a9afca7e67d8ead00c53bd (patch) | |
| tree | 7cf1ce22a8b8ea7d711662947fc698e1718905d3 /common/ngram-cache.cpp | |
| parent | ddf65685105a39a57b1e7f80c3aa502a6313af24 (diff) | |
sampling : deduplicated code for probability distribution access (#6240)
* sampling: remove duplicated code for probability distribution access
* free original_logits
* fix original_logits allocation
* fixes based on review @cebtenzzre
* change function name to `llama_sampling_prepare`
Diffstat (limited to 'common/ngram-cache.cpp')
0 files changed, 0 insertions, 0 deletions