summaryrefslogtreecommitdiff
path: root/ggml-quants.c
AgeCommit message (Expand)Author
2024-05-11build: fix and ignore msvc warnings (ggml/805)Borislav Stanimirov
2024-05-08ggml : introduce bfloat16 support (#6412)Justine Tunney
2024-04-26add basic tensor data validation function (#6884)slaren
2024-04-25ggml : fix MIN / MAX macros (#6904)Georgi Gerganov
2024-04-24ggml : move 32-bit arm compat in ggml-impl.h (#6865)Georgi Gerganov
2024-04-16ggml : add llamafile sgemm (#6414)Justine Tunney
2024-04-09llama : add Command R Plus support (#6491)Carolinabanana
2024-03-27Make IQ1_M work for QK_K = 64 (#6327)Kawrakow
2024-03-26IQ1_M: 1.75 bpw quantization (#6302)Kawrakow
2024-03-25ggml : support AVX512VNNI (#6280)Justine Tunney
2024-03-21ggml : same IQ4_NL quantization for CPU/CUDA/Metal (#6196)Kawrakow
2024-03-12ggml : reuse quantum structs across backends (#5943)Georgi Gerganov
2024-03-12ggml : fix UB in IQ2_S and IQ3_S (#6012)Georgi Gerganov
2024-03-111.5 bit: we can do even better (#5999)Kawrakow
2024-03-11ggml, ci : Windows ARM runner and build fixes (#5979)Michael Podvitskiy
2024-03-11Better 1.5 bit quantization (#5971)Kawrakow
2024-03-10ggml : try fix 32-bit arm compat (whisper/1938)Georgi Gerganov
2024-03-09ggml : fix unnecessary f32 -> f16 -> f32 casts (mmla) (#5951)Georgi Gerganov
2024-03-09ggml : remove old quantization functions (#5942)Georgi Gerganov
2024-03-09ggml : add ggml-common.h to deduplicate shared code (#5940)Georgi Gerganov
2024-03-06ggml : use `uint8x16_t` return type for `ggml_vqtbl1q_u8` (#5894)bobqianic
2024-03-05quants : use MM256_SET_M128I consistently to fix gcc 7 build (#5889)Jared Van Bortel
2024-03-02ggml : fix IQ3_S AVX implementation (#5834)Georgi Gerganov
2024-03-02ggml : IQ3_S improvements (#5829)Kawrakow
2024-02-28ggml : make i-quants work with super-blocks of 64 (CPU,Metal) (#5760)Kawrakow
2024-02-27Attempt to fix android build (#5752)Kawrakow
2024-02-27IQ4_XS: a 4.25 bpw quantization (#5747)Kawrakow
2024-02-27ggml-quants : fix avx2 iq1_s vec_dot when compiled with gcc (#5742)Engininja2
2024-02-26Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range...Kawrakow
2024-02-25ggml-quants : provide ggml_vqtbl1q_u8 for 64bit compatibility (#5711)Radosław Gryta
2024-02-24IQ3_S: a much better alternative to Q3_K (#5676)Kawrakow
2024-02-22ggml : always define ggml_fp16_t as uint16_t (#5666)Georgi Gerganov
2024-02-22ggml : 32-bit arm compat (whisper/1891)Georgi Gerganov
2024-02-21IQ4_NL: 4-bit non-linear quants with blocks of 32 (#5590)Kawrakow
2024-02-18ggml : restore vec dot stride arg names (#5453)Georgi Gerganov
2024-02-18ci : fix wikitext url + compile warnings (#5569)Georgi Gerganov
2024-02-181.5 bit quantization (#5453)Kawrakow
2024-02-13ggml-quants : fix compiler warnings (shadow variable) (#5472)Kawrakow
2024-02-11ggml : fix compile warnings (unused vars) (#4966)Georgi Gerganov
2024-02-11ggml : add mmla kernels for quantized GEMM (#4966)snadampal
2024-02-09ggml : fix `error C2078: too many initializers` for MSVC ARM64 (#5404)Michael Podvitskiy
2024-02-06Slight quantization improvement for Q4_K and Q5_K (#5361)Kawrakow
2024-02-05iq2_xxs: tune quantization (#5320)Kawrakow
2024-01-30Faster AVX2 dot product for IQ2_XS (#5187)Kawrakow
2024-01-30SOTA 3-bit quants (#5196)Kawrakow
2024-01-17ggml : add IQ2 to test-backend-ops + refactoring (#4990)Georgi Gerganov
2024-01-16ggml : importance matrix support for legacy quants (#4969)Kawrakow
2024-01-14Add ability to use importance matrix for all k-quants (#4930)Kawrakow
2024-01-142-bit quantizations (#4897)Kawrakow
2024-01-12ggml : fix 32-bit ARM compat for IQ2_XS (whisper/1758)Georgi Gerganov