summaryrefslogtreecommitdiff
path: root/common/common.cpp
AgeCommit message (Expand)Author
2025-06-08Fix non rpc build error (#506)firecoperana
2025-06-08Revert "Rpc improvement (#480)"Iwan Kawrakow
2025-06-08Rpc improvement (#480)firecoperana
2025-06-03Adding top-n-sigma sampler (#489)Kawrakow
2025-06-03Adding the XTC sampler (#486)Kawrakow
2025-05-12Add batch warmup to sweep-bench (#375)Kawrakow
2025-05-12Enable faster prompt processing with mainline llama.cpp GGUFs (#409)Kawrakow
2025-05-12GPU offload policy (#405)Kawrakow
2025-04-07Add copyright notices (#317)Kawrakow
2025-03-23Test transparent huge pages on Linux (#278)Kawrakow
2025-03-02SER - Smart Expert Reduction (#239)Kawrakow
2025-03-01Reduce size of compute buffers (#237)Kawrakow
2025-02-27Option to use MLA without a transposed cache (#235)Kawrakow
2025-02-25Give the user the option to override where model weights are stored (#232)Kawrakow
2025-02-23Fused MoE ffn_up and ffn_gate (#229)Kawrakow
2025-02-23Add new sweep-bench benchmark (#225)saood06
2025-02-19Q8_KV: 8-bit quantization type targeting the KV cache (#208)Kawrakow
2025-02-10 Load all MoE experts during warmup and make warmup 1 token (#198)saood06
2025-02-09Add optional MLA (#188)Kawrakow
2024-12-17Be able to repack tensors at run time (#147)Kawrakow
2024-10-02Adding Q6_0 (#77)Kawrakow
2024-09-05Zen4 Flash Attention - bf16 support (#38)Kawrakow
2024-09-02Do not process prompts containing binary data for escapes (#33)Kawrakow
2024-08-12Merge mainline - Aug 12 2024 (#17)Kawrakow
2024-07-27Merge mainline llama.cpp (#3)Kawrakow
2024-06-26imatrix: be able to specify the name of the output tensorIwan Kawrakow
2024-06-21llama : allow pooled embeddings on any model (#7477)Douglas Hanley
2024-06-20common: fix warning (#8036)Johannes Gäßler
2024-06-15Add `cvector-generator` example (#7514)Xuan Son Nguyen
2024-06-08url: save -mu downloads to new cache location (#7826)Olivier Chafik
2024-06-08server : smart slot selection using Longest Common Prefix (#7728)sasha0552
2024-06-06server : fix --threads-http arg (#7801)Georgi Gerganov
2024-06-06imatrix : migrate to gpt_params (#7771)Georgi Gerganov
2024-06-04common : refactor cli arg parsing (#7675)Georgi Gerganov
2024-06-04ggml : remove OpenCL (#7735)Georgi Gerganov
2024-06-03Vulkan Mixture of Experts (MoE) support (#7628)0cc4m
2024-05-27main: replace --no-special with --special (#7534)Brian
2024-05-25main : don't print special tokens with --grammar (#6923)Justine Tunney
2024-05-25ggml: aarch64: SVE kernels for q8_0_q8_0, q4_0_q8_0 vector dot (#7433)Masaya, Kato
2024-05-25fix missing slash in `fs_get_cache_directory()` (#7503)Xuan Son Nguyen
2024-05-22common : normalize naming style (#7462)Georgi Gerganov
2024-05-21examples: cache hf model when --model not provided (#7353)Amir
2024-05-17ggml-quants, llama : removed excess checks (#7274)Herman Semenov
2024-05-14ggml : add RPC backend (#6829)Radoslav Gerganov
2024-05-10Fix memory bug in grammar parser (#7194)Justine Tunney
2024-05-10Main+: optionally allow special tokens from user in interactive mode (#7097)HanishKVC
2024-05-08JSON: [key] -> .at(key), assert() -> GGML_ASSERT (#7143)Johannes Gäßler
2024-05-08main : add --conversation / -cnv flag (#7108)Dawid Potocki
2024-05-04Fix Linux /sys cpu path to guess number of cores (#7064)viric
2024-04-30ggml : add Flash Attention (#5021)Georgi Gerganov