summaryrefslogtreecommitdiff
path: root/common/sampling.cpp
AgeCommit message (Expand)Author
2024-04-24Server: fix seed for multiple slots (#6835)Johannes Gäßler
2024-03-24sampling : deduplicated code for probability distribution access (#6240)Minsoo Cheong
2024-03-13grammar : handle missing "root" node (#6004)Clint Herron
2024-03-04speculative : implement stochastic speculative sampling (#5625)Minsoo Cheong
2024-02-25server: tests - slow inference causes timeout on the CI (#5715)Pierrick Hymbert
2024-02-18common, server : surface min_keep as its own parameter (#5567)Robey Holderith
2024-02-18sampling : do not set min_keep to n_probs (#5564)Georgi Gerganov
2024-02-16server : add "samplers" param to control the samplers order (#5494)Alexey Parfenov
2024-02-11common : use enums for sampler types (#5418)Alexey Parfenov
2024-02-11common : fix compile warningGeorgi Gerganov
2024-02-08sampling: fix top_k <= 0 (#5388)Johannes Gäßler
2024-01-27Remove unused data and add fixes (#5154)Michael Klimenko
2024-01-25llama : dynamic temperature sampling (#4972)l3utterfly
2024-01-15llama : apply classifier-free guidance to logits directly (#4951)David Friehs
2023-12-23server : allow to specify custom prompt for penalty calculation (#3727)Alexey Parfenov
2023-12-23grammar : check the full vocab only if necessary (opt) (#4306)kalomaze
2023-12-06common : fix compile warningGeorgi Gerganov
2023-12-05sampling : custom samplers order (#4285)MaggotHATE
2023-11-01sampling : null grammar field after reset (#3885)l3utterfly
2023-10-31samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841)kalomaze
2023-10-28llama : add option for greedy sampling with probs (#3813)Georgi Gerganov
2023-10-23llama : remove token functions with `context` args in favor of `model` (#3720)Marcus Dunn
2023-10-20sampling : refactor init to use llama_sampling_params (#3696)Georgi Gerganov
2023-10-18speculative : add tree-based sampling example (#3624)Georgi Gerganov
2023-10-11common : fix mirostat state when using multiple sequences (#3543)Kerfuffle
generated by cgit v1.2.3 (git 2.25.1) at 2025-08-16 23:19:10 +0000