summaryrefslogtreecommitdiff
path: root/ggml-quants.c
AgeCommit message (Expand)Author
2024-06-22bitnet: add 2 bpw quantizationIwan Kawrakow
2024-06-22Move Q8_K64 quantization to iqk-quantize.cpp and add copyright noticeIwan Kawrakow
2024-06-22iqk_mul_mat: improve iq1_bn (bitnet) on AVX2Iwan Kawrakow
2024-06-22bitnet: scale is per row, not per tensorIwan Kawrakow
2024-06-22bitnet: CUDA, scalar, AVX2Iwan Kawrakow
2024-06-22Fix nb4Iwan Kawrakow
2024-06-22iqk_mul_mat: add ability to disable itIwan Kawrakow
2024-06-22iqk_mul_mat: use block_q8_1_x4 also for AVX2Iwan Kawrakow
2024-06-22iqk_mul_mat: use block_q8_0_x4 also for AVX2Iwan Kawrakow
2024-06-22iqk_mul_mat for llama.cppIwan Kawrakow
2024-06-21ggml : AVX IQ quants (#7845)Eve
2024-06-16ggml : fix and optimize ppc64le (ggml/849)Hong Bo PENG
2024-06-16ggml : remove duplicate include of ggml-common.h (ggml/853)Daniel Bevenius
2024-06-16ggml : fix handling of zero blocks in IQ quants (#7955)Georgi Gerganov
2024-05-31ggml : fix loongson compile warnings (#7537)Georgi Gerganov
2024-05-30ggml : fix loongarch build (O2 issue) (#7636)junchao-loongson
2024-05-25ggml: aarch64: SVE kernels for q8_0_q8_0, q4_0_q8_0 vector dot (#7433)Masaya, Kato
2024-05-23ggml : silence UB sanitizer error during iq2_xxs quantization (#0)Georgi Gerganov
2024-05-23ggml : drop support for QK_K=64 (#7473)Georgi Gerganov
2024-05-20ggml : add loongarch lsx and lasx support (#6454)junchao-loongson
2024-05-19ggml : fix another case of quants nans (#7387)slaren
2024-05-18ggml : fix quants nans when all the group weights are very close to zero (#7313)slaren
2024-05-17ggml-quants, llama : removed excess checks (#7274)Herman Semenov
2024-05-16Add support for properly optimized Windows ARM64 builds with LLVM and MSVC (#...Max Krasnyansky
2024-05-14ggml : try fix ppc64 (whisper/0)Georgi Gerganov
2024-05-14ggml : optimize for ppc64le using VSX intrinsics (ggml/784)Hong Bo PENG
2024-05-11build: fix and ignore msvc warnings (ggml/805)Borislav Stanimirov
2024-05-08ggml : introduce bfloat16 support (#6412)Justine Tunney
2024-04-26add basic tensor data validation function (#6884)slaren
2024-04-25ggml : fix MIN / MAX macros (#6904)Georgi Gerganov
2024-04-24ggml : move 32-bit arm compat in ggml-impl.h (#6865)Georgi Gerganov
2024-04-16ggml : add llamafile sgemm (#6414)Justine Tunney
2024-04-09llama : add Command R Plus support (#6491)Carolinabanana
2024-03-27Make IQ1_M work for QK_K = 64 (#6327)Kawrakow
2024-03-26IQ1_M: 1.75 bpw quantization (#6302)Kawrakow
2024-03-25ggml : support AVX512VNNI (#6280)Justine Tunney
2024-03-21ggml : same IQ4_NL quantization for CPU/CUDA/Metal (#6196)Kawrakow
2024-03-12ggml : reuse quantum structs across backends (#5943)Georgi Gerganov
2024-03-12ggml : fix UB in IQ2_S and IQ3_S (#6012)Georgi Gerganov
2024-03-111.5 bit: we can do even better (#5999)Kawrakow
2024-03-11ggml, ci : Windows ARM runner and build fixes (#5979)Michael Podvitskiy
2024-03-11Better 1.5 bit quantization (#5971)Kawrakow
2024-03-10ggml : try fix 32-bit arm compat (whisper/1938)Georgi Gerganov
2024-03-09ggml : fix unnecessary f32 -> f16 -> f32 casts (mmla) (#5951)Georgi Gerganov
2024-03-09ggml : remove old quantization functions (#5942)Georgi Gerganov
2024-03-09ggml : add ggml-common.h to deduplicate shared code (#5940)Georgi Gerganov
2024-03-06ggml : use `uint8x16_t` return type for `ggml_vqtbl1q_u8` (#5894)bobqianic
2024-03-05quants : use MM256_SET_M128I consistently to fix gcc 7 build (#5889)Jared Van Bortel
2024-03-02ggml : fix IQ3_S AVX implementation (#5834)Georgi Gerganov
2024-03-02ggml : IQ3_S improvements (#5829)Kawrakow