summaryrefslogtreecommitdiff
path: root/ggml-cuda.cu
AgeCommit message (Expand)Author
2024-02-26Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range...Kawrakow
2024-02-26CUDA: fix DEBUG_CUDA_MALLOC (#5729)Johannes Gäßler
2024-02-25code : normalize enum names (#5697)Georgi Gerganov
2024-02-24IQ3_S: a much better alternative to Q3_K (#5676)Kawrakow
2024-02-22ggml : always define ggml_fp16_t as uint16_t (#5666)Georgi Gerganov
2024-02-21IQ4_NL: 4-bit non-linear quants with blocks of 32 (#5590)Kawrakow
2024-02-19cuda : ignore peer access already enabled errors (#5597)slaren
2024-02-19ci : enable -Werror for CUDA builds (#5579)Georgi Gerganov
2024-02-19cuda, metal : fix nans in soft_max (#5574)slaren
2024-02-181.5 bit quantization (#5453)Kawrakow
2024-02-17ggml : add ALiBi support for ggml_soft_max_ext (#5488)Georgi Gerganov
2024-02-15cuda : print message when initialization fails (#5512)slaren
2024-02-11CUDA: mul_mat_vec_q tiling, refactor mul mat logic (#5434)Johannes Gäßler
2024-02-08CUDA: more warps for mmvq on NVIDIA (#5394)Johannes Gäßler
2024-02-07CUDA: fixed mmvq kernel for bs 2,3,4 and -sm row (#5386)Johannes Gäßler
2024-02-06CUDA: mul_mat_vec_q max. batch size 8 -> 4 (#5370)Johannes Gäßler
2024-02-06CUDA: mul_mat_vec_q for batch sizes > 1 (#5351)Johannes Gäßler
2024-02-01cuda : fix LLAMA_CUDA_F16 (#5262)slaren
2024-01-31llava : add MobileVLM support (#5132)JidongZhang-THU
2024-01-30sync : ggml (#0)Georgi Gerganov
2024-01-30`ggml_cuda_cpy` support for 4d tensors and float16->float32 upcasting (ggml/686)John Balis
2024-01-30SOTA 3-bit quants (#5196)Kawrakow
2024-01-28ggml : add Vulkan backend (#2059)0cc4m
2024-01-26cuda : fix tensor size calculation for non-split buffer (#5145)slaren
2024-01-24cuda : fix 2-bit quants on amd hip (#5105)Engininja2
2024-01-23CUDA: more info when no device code (#5088)Johannes Gäßler
2024-01-20cuda : fix compile error in jetson platform (#4975)Kylin
2024-01-17ggml : add IQ2 to test-backend-ops + refactoring (#4990)Georgi Gerganov
2024-01-16ggml : introduce GGML_CALL function annotation (#4850)Justine Tunney
2024-01-15cuda : fix dequantize kernel names (#4938)Georgi Gerganov
2024-01-15CUDA: faster dequantize kernels for Q4_0 and Q4_1 (#4938)Kawrakow
2024-01-12CUDA: faster q8_0 -> f16 dequantization (#4895)Johannes Gäßler
2024-01-12llama : ggml-backend integration (#4766)slaren
2024-01-12CUDA: fix softmax compile for old CUDA versions (#4862)Johannes Gäßler
2024-01-11ggml : SOTA 2-bit quants (add IQ2_XS) (#4856)Kawrakow
2024-01-11fix : cuda order of synchronization when setting a buffer (ggml/679)Erik Scholz
2024-01-09CUDA: faster softmax via shared memory + fp16 math (#4742)Johannes Gäßler
2024-01-08SOTA 2-bit quants (#4773)Kawrakow
2024-01-07CUDA: fixed redundant value dequantization (#4809)Johannes Gäßler
2024-01-07ggml : use __builtin_amdgcn_sudot4 in __dp4a for gfx11 (#4787)Konstantin Zhuravlyov
2024-01-05ggml : add error handling to graph_compute (whisper/1714)Finn Voorhees
2024-01-03cuda : simplify expressionGeorgi Gerganov
2024-01-03cuda : mark I16 and I32 ops as unsupportedGeorgi Gerganov
2023-12-30CUDA: fixed tensor cores not being used on RDNA3 (#4697)Johannes Gäßler
2023-12-29CUDA: fix tensor core logic for Pascal and HIP (#4682)Johannes Gäßler
2023-12-29cuda: fix vmm oom issue on NVIDIA AGX Orin (#4687)hydai
2023-12-29ggml : fix some mul mat cases + add tests for src1 F16 (ggml/669)bssrdf
2023-12-26cuda : fix vmm pool with multi GPU (#4620)slaren
2023-12-26Fix new CUDA10 compilation errors (#4635)FantasyGmm
2023-12-24cuda : improve cuda pool efficiency using virtual memory (#4606)slaren
generated by cgit v1.2.3 (git 2.25.1) at 2026-01-10 13:26:58 +0000