summaryrefslogtreecommitdiff
AgeCommit message (Expand)Author
2025-06-11IQ2_XXS: much faster CPU prompt processing (#515)Kawrakow
2025-06-10Fix Compile error (C2668) (#508)Gaolingx
2025-06-09Docs update (#509)saood06
2025-06-08Fix non rpc build error (#506)firecoperana
2025-06-08Revert "Rpc improvement (#480)"Iwan Kawrakow
2025-06-08Rpc improvement (#480)firecoperana
2025-06-08Update AUTHORSKawrakow
2025-06-08Webui improvement (#481)firecoperana
2025-06-07Add an endpoint that lists all the saved prompt caches to server (#502)saood06
2025-06-07Fix #499 (#501)Kawrakow
2025-06-06Make prompt cache saving and restoring MLA aware (#497)saood06
2025-06-05IQ1_M_R4 CUDA implementation (#494)Kawrakow
2025-06-05MMQ implementation for IQ4_KS_R4 and IQ5_KS_R4 (#493)Kawrakow
2025-06-05Faster CPU prompt processing for Trellis quants and MoE models (#488)Kawrakow
2025-06-05CUDA implementation for IQ1_S_R4 (#492)Kawrakow
2025-06-03Adding top-n-sigma sampler (#489)Kawrakow
2025-06-03Adding the XTC sampler (#486)Kawrakow
2025-06-03 convert_hf_to_gguf.py : conversion from hf weights to Q6_0 (#483)Nexes the Elder
2025-06-01Minor (~2%) iq2_ks TG performance improvement on CUDA (#468)Kawrakow
2025-06-01Trellis quants: faster CPU prompt processing (#482)Kawrakow
2025-06-01Metal implementatio for the trellis quants. (#475)Kawrakow
2025-05-31forgotten refs and typo (#478)Nexes the Elder
2025-05-30Replace MLA-specific KV cache with the standard KV cache (#469)Kawrakow
2025-05-29NEON implementation for trellis quants (#471)Kawrakow
2025-05-28set cache_prompt default to true (#465)saood06
2025-05-27CUDA GEMM and GEMV for IQ4_KS_R4 and IQ5_KS_R4 (#462)Kawrakow
2025-05-26CUDA implementation for IQ2_K_R4, IQ3_K_R4, IQ4_K_R4, IQ5_K_R4 (#461)Kawrakow
2025-05-25Add missing gguf-py constants (#458)Kawrakow
2025-05-24Legacy quants conversion schemes in convert_hf_to_gguf.py (#449)Nexes the Elder
2025-05-24Faster IQ3_KT and IQ4_KT (#453)Kawrakow
2025-05-23Fix bug in MMVQ kernel (#446)Kawrakow
2025-05-23Fix MSVC compilation (#448)Kawrakow
2025-05-23Fix typo in non-AVX2 code branch (#445)Kawrakow
2025-05-23Trellis quants with CPU inference (#441)Andrew Chan
2025-05-23gguf-split : update (#444)Nexes the Elder
2025-05-22Streamline a bit the quant strategies (#443)Nexes the Elder
2025-05-22Refactor iqk_mul_mat.cpp (#435)Kawrakow
2025-05-20Bug fixes from mainline (#439)Kawrakow
2025-05-18Forgotten MMQ ref and typo (#431)Nexes the Elder
2025-05-17Option to enable disable the IQK CPU FA kernels (#429)Kawrakow
2025-05-17Zen4: Faster PP for IQ2_KS, IQ4_KS, IQ5_KS (#428)Kawrakow
2025-05-17IQ5_KS_R4: row-interleaved IQ5_KS (#426)Kawrakow
2025-05-16Fix AVX2 implementation of IQ4_K, IQ4_KS, IQ5_K, IQ6_K (#427)Kawrakow
2025-05-15Adding forgotten template instance for iq5_ks (#424)Kawrakow
2025-05-15Adding IQ5_KS - 5.25 bpw quants (#422)Kawrakow
2025-05-15Fix standard attention on the CPU (#421)Kawrakow
2025-05-15CUDA: quantized GEMM for for IQ2_KS, IQ2_K, IQ3_K (#418)Kawrakow
2025-05-14CUDA: quantized GEMM for for IQ4_K, IQ5_K, IQ6_K (#417)Kawrakow
2025-05-14Fix SER (CUDA) (#416)Kawrakow
2025-05-13Fix SER (CPU) (#415)Kawrakow