summaryrefslogtreecommitdiff
path: root/examples/speculative/speculative.cpp
AgeCommit message (Expand)Author
2025-06-19add dry sampler (#513)firecoperana
2024-08-12Merge mainline - Aug 12 2024 (#17)Kawrakow
2024-06-04common : refactor cli arg parsing (#7675)Georgi Gerganov
2024-04-21llama : support Llama 3 HF conversion (#6745)Pedro Cuenca
2024-04-09BERT tokenizer fixes (#6498)Jared Van Bortel
2024-03-26llama : greatly reduce output buffer memory usage (#6122)compilade
2024-03-24sampling : deduplicated code for probability distribution access (#6240)Minsoo Cheong
2024-03-04fix speculative decoding build on windows (#5874)Jeffrey Quesnelle
2024-03-04speculative : implement stochastic speculative sampling (#5625)Minsoo Cheong
2024-02-16ggml : add numa options (#5377)bmwl
2024-01-16speculative : threading options (#4959)stduhpf
2023-12-12english : use `typos` to fix comments and logs (#4354)Richard Kiss
2023-12-06speculative : support `--color` (#4343)stduhpf
2023-11-20speculative : fix prompt tokenization in speculative example (#4025)Branden Butler
2023-11-03speculative : change default p_accept to 0.5 + CLI args (#3919)Georgi Gerganov
2023-11-02build : link against build info instead of compiling against it (#3879)cebtenzzre
2023-10-28llama : add option for greedy sampling with probs (#3813)Georgi Gerganov
2023-10-28speculative : ensure draft and target model vocab matches (#3812)Kerfuffle
2023-10-23llama : remove token functions with `context` args in favor of `model` (#3720)Marcus Dunn
2023-10-20sampling : refactor init to use llama_sampling_params (#3696)Georgi Gerganov
2023-10-18speculative : bug fixesGeorgi Gerganov
2023-10-18speculative : add tree-based sampling example (#3624)Georgi Gerganov
2023-10-11common : fix mirostat state when using multiple sequences (#3543)Kerfuffle
2023-10-03llama : fix session saving/loading (#3400)Georgi Gerganov
2023-09-28llama.cpp : split llama_context_params into model and context params (#3301)slaren
2023-09-28llama : custom attention mask + parallel decoding + no context swaps (#3228)Georgi Gerganov
2023-09-14speculative : add heuristic algorithm (#3006)Leng Yue
2023-09-13speculative: add --n-gpu-layers-draft option (#3063)FK
2023-09-08build : do not use _GNU_SOURCE gratuitously (#2035)Przemysław Pawełczyk
2023-09-05speculative : add grammar support (#2991)Georgi Gerganov
2023-09-03speculative : PoC for speeding-up inference via speculative sampling (#2926)Georgi Gerganov