index
:
ik_llama.cpp.git
main
Unnamed repository; edit this file 'description' to name the repository.
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
examples
/
speculative
/
speculative.cpp
Age
Commit message (
Expand
)
Author
2023-10-28
llama : add option for greedy sampling with probs (#3813)
Georgi Gerganov
2023-10-28
speculative : ensure draft and target model vocab matches (#3812)
Kerfuffle
2023-10-23
llama : remove token functions with `context` args in favor of `model` (#3720)
Marcus Dunn
2023-10-20
sampling : refactor init to use llama_sampling_params (#3696)
Georgi Gerganov
2023-10-18
speculative : bug fixes
Georgi Gerganov
2023-10-18
speculative : add tree-based sampling example (#3624)
Georgi Gerganov
2023-10-11
common : fix mirostat state when using multiple sequences (#3543)
Kerfuffle
2023-10-03
llama : fix session saving/loading (#3400)
Georgi Gerganov
2023-09-28
llama.cpp : split llama_context_params into model and context params (#3301)
slaren
2023-09-28
llama : custom attention mask + parallel decoding + no context swaps (#3228)
Georgi Gerganov
2023-09-14
speculative : add heuristic algorithm (#3006)
Leng Yue
2023-09-13
speculative: add --n-gpu-layers-draft option (#3063)
FK
2023-09-08
build : do not use _GNU_SOURCE gratuitously (#2035)
Przemysław Pawełczyk
2023-09-05
speculative : add grammar support (#2991)
Georgi Gerganov
2023-09-03
speculative : PoC for speeding-up inference via speculative sampling (#2926)
Georgi Gerganov