summaryrefslogtreecommitdiff
path: root/ggml-quants.c
AgeCommit message (Expand)Author
2024-03-09ggml : add ggml-common.h to deduplicate shared code (#5940)Georgi Gerganov
2024-03-06ggml : use `uint8x16_t` return type for `ggml_vqtbl1q_u8` (#5894)bobqianic
2024-03-05quants : use MM256_SET_M128I consistently to fix gcc 7 build (#5889)Jared Van Bortel
2024-03-02ggml : fix IQ3_S AVX implementation (#5834)Georgi Gerganov
2024-03-02ggml : IQ3_S improvements (#5829)Kawrakow
2024-02-28ggml : make i-quants work with super-blocks of 64 (CPU,Metal) (#5760)Kawrakow
2024-02-27Attempt to fix android build (#5752)Kawrakow
2024-02-27IQ4_XS: a 4.25 bpw quantization (#5747)Kawrakow
2024-02-27ggml-quants : fix avx2 iq1_s vec_dot when compiled with gcc (#5742)Engininja2
2024-02-26Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range...Kawrakow
2024-02-25ggml-quants : provide ggml_vqtbl1q_u8 for 64bit compatibility (#5711)Radosław Gryta
2024-02-24IQ3_S: a much better alternative to Q3_K (#5676)Kawrakow
2024-02-22ggml : always define ggml_fp16_t as uint16_t (#5666)Georgi Gerganov
2024-02-22ggml : 32-bit arm compat (whisper/1891)Georgi Gerganov
2024-02-21IQ4_NL: 4-bit non-linear quants with blocks of 32 (#5590)Kawrakow
2024-02-18ggml : restore vec dot stride arg names (#5453)Georgi Gerganov
2024-02-18ci : fix wikitext url + compile warnings (#5569)Georgi Gerganov
2024-02-181.5 bit quantization (#5453)Kawrakow
2024-02-13ggml-quants : fix compiler warnings (shadow variable) (#5472)Kawrakow
2024-02-11ggml : fix compile warnings (unused vars) (#4966)Georgi Gerganov
2024-02-11ggml : add mmla kernels for quantized GEMM (#4966)snadampal
2024-02-09ggml : fix `error C2078: too many initializers` for MSVC ARM64 (#5404)Michael Podvitskiy
2024-02-06Slight quantization improvement for Q4_K and Q5_K (#5361)Kawrakow
2024-02-05iq2_xxs: tune quantization (#5320)Kawrakow
2024-01-30Faster AVX2 dot product for IQ2_XS (#5187)Kawrakow
2024-01-30SOTA 3-bit quants (#5196)Kawrakow
2024-01-17ggml : add IQ2 to test-backend-ops + refactoring (#4990)Georgi Gerganov
2024-01-16ggml : importance matrix support for legacy quants (#4969)Kawrakow
2024-01-14Add ability to use importance matrix for all k-quants (#4930)Kawrakow
2024-01-142-bit quantizations (#4897)Kawrakow
2024-01-12ggml : fix 32-bit ARM compat for IQ2_XS (whisper/1758)Georgi Gerganov
2024-01-11ggml : SOTA 2-bit quants (add IQ2_XS) (#4856)Kawrakow
2024-01-09ggml : fix vld1q_s8_x4 32-bit compat (#4828)Georgi Gerganov
2024-01-08SOTA 2-bit quants (#4773)Kawrakow
2023-12-31ggml : add ggml_vdotq_s32 alias (#4715)Georgi Gerganov
2023-12-27ggml : fix dot product for ARM (#4630)Georgi Gerganov
2023-12-22cuda : fix jetson compile error (#4560)FantasyGmm
2023-12-12english : use `typos` to fix comments and logs (#4354)Richard Kiss
2023-11-17build : support ppc64le build for make and CMake (#3963)Roger Meier
2023-11-14Fix MacOS Sonoma model quantization (#4052)Michael Potter
2023-11-13ggml : sync (im2col, GPU conv, 32-bit arm compat) (#4060)Georgi Gerganov
2023-11-01ggml : fix UNUSED macro (#3762)Georgi Gerganov
2023-11-01finetune : add -ngl parameter (#3762)Andrew Godfrey
2023-10-30ggml : move FP16 <-> FP32 code to ggml-impl.h (#3861)Georgi Gerganov
2023-10-29ggml : quantization refactoring (#3833)Georgi Gerganov