summaryrefslogtreecommitdiff
AgeCommit message (Expand)Author
2025-06-22Abort if IQK_IMPLEMENT is not definedIwan Kawrakow
2025-06-21Faster ARM_NEON GEMM implementation for legacy quants (#546)Kawrakow
2025-06-21Perhaps slightly faster trellis quants (#541)Kawrakow
2025-06-20New integer trellis on ARM_NEON (#544)Kawrakow
2025-06-19Fix NEON build (#542)Kawrakow
2025-06-19add dry sampler (#513)firecoperana
2025-06-19Minor readme update (#535)saood06
2025-06-19Update CMakeLists.txt to fix NDEBUG handling (#537)Anton Sokolchenko
2025-06-19Fix missed block_q8_x2 bf16 -> i16 change (#540)Kawrakow
2025-06-18Fix KT Neon / ARM typo (#536)Louie Helm
2025-06-18Fix MSVC compilation errorIwan Kawrakow
2025-06-18New IQ2_KT, IQ3_KT and IQ4_KT, V2 (#529)Kawrakow
2025-06-18Much faster CPU prompt processing (part 3) (#534)Kawrakow
2025-06-18Much faster CPU prompt processing (part 2) (#533)Kawrakow
2025-06-17Send [DONE] for OAI compatibility (#470)Kawrakow
2025-06-17Much faster CPU prompt processing (part 1) (#531)Kawrakow
2025-06-14Call iqk_convert_repack in MoE GEMM (#528)Kawrakow
2025-06-13Faster CPU prompt processing for Q4_K and Q5_K (#525)Kawrakow
2025-06-13Update News section of readme (#510)saood06
2025-06-13Perhaps a slightly better version for IQ2_XXS, IQ3_XXS, IQ3_S GEMV (#524)Kawrakow
2025-06-12Better strategy for GPU offload (#520)Kawrakow
2025-06-12Add top n sigma sampler and other webui fix (#512)firecoperana
2025-06-12iq3_s: much faster GEMM via repacking to q8_0_r8 (#518)Kawrakow
2025-06-11Faster iq1_s GEMM via repacking to Q8_0_R8 (#517)Kawrakow
2025-06-11Much faster iq3_xxs GEMM via repacking to q8_0_r8 (AVX2) (#516)Kawrakow
2025-06-11IQ2_XXS: much faster CPU prompt processing (#515)Kawrakow
2025-06-10Fix Compile error (C2668) (#508)Gaolingx
2025-06-09Docs update (#509)saood06
2025-06-08Fix non rpc build error (#506)firecoperana
2025-06-08Revert "Rpc improvement (#480)"Iwan Kawrakow
2025-06-08Rpc improvement (#480)firecoperana
2025-06-08Update AUTHORSKawrakow
2025-06-08Webui improvement (#481)firecoperana
2025-06-07Add an endpoint that lists all the saved prompt caches to server (#502)saood06
2025-06-07Fix #499 (#501)Kawrakow
2025-06-06Make prompt cache saving and restoring MLA aware (#497)saood06
2025-06-05IQ1_M_R4 CUDA implementation (#494)Kawrakow
2025-06-05MMQ implementation for IQ4_KS_R4 and IQ5_KS_R4 (#493)Kawrakow
2025-06-05Faster CPU prompt processing for Trellis quants and MoE models (#488)Kawrakow
2025-06-05CUDA implementation for IQ1_S_R4 (#492)Kawrakow
2025-06-03Adding top-n-sigma sampler (#489)Kawrakow
2025-06-03Adding the XTC sampler (#486)Kawrakow
2025-06-03 convert_hf_to_gguf.py : conversion from hf weights to Q6_0 (#483)Nexes the Elder
2025-06-01Minor (~2%) iq2_ks TG performance improvement on CUDA (#468)Kawrakow
2025-06-01Trellis quants: faster CPU prompt processing (#482)Kawrakow
2025-06-01Metal implementatio for the trellis quants. (#475)Kawrakow
2025-05-31forgotten refs and typo (#478)Nexes the Elder
2025-05-30Replace MLA-specific KV cache with the standard KV cache (#469)Kawrakow
2025-05-29NEON implementation for trellis quants (#471)Kawrakow
2025-05-28set cache_prompt default to true (#465)saood06
generated by cgit v1.2.3 (git 2.25.1) at 2026-01-11 04:15:43 +0000