summaryrefslogtreecommitdiff
path: root/ggml/src
AgeCommit message (Expand)Author
2025-06-22Abort if IQK_IMPLEMENT is not definedIwan Kawrakow
2025-06-21Faster ARM_NEON GEMM implementation for legacy quants (#546)Kawrakow
2025-06-21Perhaps slightly faster trellis quants (#541)Kawrakow
2025-06-20New integer trellis on ARM_NEON (#544)Kawrakow
2025-06-19Fix NEON build (#542)Kawrakow
2025-06-19Update CMakeLists.txt to fix NDEBUG handling (#537)Anton Sokolchenko
2025-06-19Fix missed block_q8_x2 bf16 -> i16 change (#540)Kawrakow
2025-06-18Fix KT Neon / ARM typo (#536)Louie Helm
2025-06-18Fix MSVC compilation errorIwan Kawrakow
2025-06-18New IQ2_KT, IQ3_KT and IQ4_KT, V2 (#529)Kawrakow
2025-06-18Much faster CPU prompt processing (part 3) (#534)Kawrakow
2025-06-18Much faster CPU prompt processing (part 2) (#533)Kawrakow
2025-06-17Much faster CPU prompt processing (part 1) (#531)Kawrakow
2025-06-14Call iqk_convert_repack in MoE GEMM (#528)Kawrakow
2025-06-13Faster CPU prompt processing for Q4_K and Q5_K (#525)Kawrakow
2025-06-13Perhaps a slightly better version for IQ2_XXS, IQ3_XXS, IQ3_S GEMV (#524)Kawrakow
2025-06-12Better strategy for GPU offload (#520)Kawrakow
2025-06-12iq3_s: much faster GEMM via repacking to q8_0_r8 (#518)Kawrakow
2025-06-11Faster iq1_s GEMM via repacking to Q8_0_R8 (#517)Kawrakow
2025-06-11Much faster iq3_xxs GEMM via repacking to q8_0_r8 (AVX2) (#516)Kawrakow
2025-06-11IQ2_XXS: much faster CPU prompt processing (#515)Kawrakow
2025-06-10Fix Compile error (C2668) (#508)Gaolingx
2025-06-08Fix non rpc build error (#506)firecoperana
2025-06-08Revert "Rpc improvement (#480)"Iwan Kawrakow
2025-06-08Rpc improvement (#480)firecoperana
2025-06-07Fix #499 (#501)Kawrakow
2025-06-05IQ1_M_R4 CUDA implementation (#494)Kawrakow
2025-06-05MMQ implementation for IQ4_KS_R4 and IQ5_KS_R4 (#493)Kawrakow
2025-06-05Faster CPU prompt processing for Trellis quants and MoE models (#488)Kawrakow
2025-06-05CUDA implementation for IQ1_S_R4 (#492)Kawrakow
2025-06-01Minor (~2%) iq2_ks TG performance improvement on CUDA (#468)Kawrakow
2025-06-01Trellis quants: faster CPU prompt processing (#482)Kawrakow
2025-06-01Metal implementatio for the trellis quants. (#475)Kawrakow
2025-05-29NEON implementation for trellis quants (#471)Kawrakow
2025-05-27CUDA GEMM and GEMV for IQ4_KS_R4 and IQ5_KS_R4 (#462)Kawrakow
2025-05-26CUDA implementation for IQ2_K_R4, IQ3_K_R4, IQ4_K_R4, IQ5_K_R4 (#461)Kawrakow
2025-05-24Legacy quants conversion schemes in convert_hf_to_gguf.py (#449)Nexes the Elder
2025-05-24Faster IQ3_KT and IQ4_KT (#453)Kawrakow
2025-05-23Fix bug in MMVQ kernel (#446)Kawrakow
2025-05-23Fix MSVC compilation (#448)Kawrakow
2025-05-23Trellis quants with CPU inference (#441)Andrew Chan
2025-05-22Refactor iqk_mul_mat.cpp (#435)Kawrakow
2025-05-20Bug fixes from mainline (#439)Kawrakow
2025-05-18Forgotten MMQ ref and typo (#431)Nexes the Elder
2025-05-17Option to enable disable the IQK CPU FA kernels (#429)Kawrakow
2025-05-17Zen4: Faster PP for IQ2_KS, IQ4_KS, IQ5_KS (#428)Kawrakow
2025-05-17IQ5_KS_R4: row-interleaved IQ5_KS (#426)Kawrakow
2025-05-16Fix AVX2 implementation of IQ4_K, IQ4_KS, IQ5_K, IQ6_K (#427)Kawrakow
2025-05-15Adding forgotten template instance for iq5_ks (#424)Kawrakow
2025-05-15Adding IQ5_KS - 5.25 bpw quants (#422)Kawrakow