summaryrefslogtreecommitdiff
path: root/ggml/src
AgeCommit message (Expand)Author
2025-05-24Faster IQ3_KT and IQ4_KT (#453)Kawrakow
2025-05-23Fix bug in MMVQ kernel (#446)Kawrakow
2025-05-23Fix MSVC compilation (#448)Kawrakow
2025-05-23Trellis quants with CPU inference (#441)Andrew Chan
2025-05-22Refactor iqk_mul_mat.cpp (#435)Kawrakow
2025-05-20Bug fixes from mainline (#439)Kawrakow
2025-05-18Forgotten MMQ ref and typo (#431)Nexes the Elder
2025-05-17Option to enable disable the IQK CPU FA kernels (#429)Kawrakow
2025-05-17Zen4: Faster PP for IQ2_KS, IQ4_KS, IQ5_KS (#428)Kawrakow
2025-05-17IQ5_KS_R4: row-interleaved IQ5_KS (#426)Kawrakow
2025-05-16Fix AVX2 implementation of IQ4_K, IQ4_KS, IQ5_K, IQ6_K (#427)Kawrakow
2025-05-15Adding forgotten template instance for iq5_ks (#424)Kawrakow
2025-05-15Adding IQ5_KS - 5.25 bpw quants (#422)Kawrakow
2025-05-15Fix standard attention on the CPU (#421)Kawrakow
2025-05-15CUDA: quantized GEMM for for IQ2_KS, IQ2_K, IQ3_K (#418)Kawrakow
2025-05-14CUDA: quantized GEMM for for IQ4_K, IQ5_K, IQ6_K (#417)Kawrakow
2025-05-14Fix SER (CUDA) (#416)Kawrakow
2025-05-13Fix SER (CPU) (#415)Kawrakow
2025-05-13Better CPU FA performance for DeepSeek-Lite (#410)Kawrakow
2025-05-12Fix new CUDA FA on Touring (#413)Kawrakow
2025-05-12Faster DeepSeek FA on CUDA (#408)Kawrakow
2025-05-12GPU offload policy (#405)Kawrakow
2025-05-11Revert "Fix race in the CUDA DeepSeek FA kernel (#406)"Iwan Kawrakow
2025-05-11Fix race in the CUDA DeepSeek FA kernel (#406)Kawrakow
2025-05-10TG improvements for MoE models (#404)Kawrakow
2025-05-09Fix CUDA FlashMLA-3 with quantized KV cache (#400)Kawrakow
2025-05-07FlashMLA-3 for DeepSeek models on CUDA (#386)Kawrakow
2025-05-07Fix DeepSeek q8_0 cache (#391)Kawrakow
2025-05-07Fix build for Xeon Gold 6226R (#390)Kawrakow
2025-05-05Fix DeepSeek FA (#382)Kawrakow
2025-05-04CUDA: MMQ for IQ4_KS (#374)Kawrakow
2025-05-04CUDA: faster FA TG for GQA models (#370)Kawrakow
2025-05-04Another attempt to fix #367 (#371)Kawrakow
2025-05-03Trying to fix iq1_s_r4/iq1_m_r4 quantization failure (#368)Kawrakow
2025-05-02Fix FA bug on AVX2 (#364)Kawrakow
2025-04-30Fix IQK_FA_ALL_QUANTS on AVX2 (#360)Kawrakow
2025-04-29CPU FA improvements (#351)Kawrakow
2025-04-26Fix division by zero bug (#349)Kawrakow
2025-04-26Add support for Cohere2 (#341)Kawrakow
2025-04-25Fix q4_1 and q5_1 on Arm (#348)Kawrakow
2025-04-25Add ability to manually set arch flags (#347)Kawrakow
2025-04-25Fix FA on ARM (#346)Kawrakow
2025-04-24cuda: use switch in constexpr funcs (#343)Kawrakow
2025-04-21Fix termux/android build (#336)saood06
2025-04-17Better TG performance for GQA models (CPU) (#332)Kawrakow
2025-04-15Better gemm/gemv on AVX2 fr q4_0_r8 (#331)Kawrakow
2025-04-15Allow q8_0 KV cache for head size 256 (#330)Kawrakow
2025-04-13Improved IQ1_M quantization (#327)Kawrakow
2025-04-07Better iq2_xs quantization (#312)Kawrakow
2025-04-07Add copyright notices (#317)Kawrakow