summaryrefslogtreecommitdiff
path: root/ggml-cuda.cu
AgeCommit message (Expand)Author
2024-03-15cuda : disable unused cudaLaunchHostFunc code (#6078)slaren
2024-03-13llama : add pipeline parallelism support (#6017)slaren
2024-03-12ggml : reuse quantum structs across backends (#5943)Georgi Gerganov
2024-03-111.5 bit: we can do even better (#5999)Kawrakow
2024-03-11Better 1.5 bit quantization (#5971)Kawrakow
2024-03-09ggml : add ggml-common.h to deduplicate shared code (#5940)Georgi Gerganov
2024-03-04ggml : introduce ggml_status (ggml/750)Michael Podvitskiy
2024-03-04add some new ops, fix some operators and add batch operations to certain oper...leejet
2024-03-03cuda : fix data race in soft max (#5853)slaren
2024-03-02ggml : IQ3_S improvements (#5829)Kawrakow
2024-02-28Introduce backend GUIDs (ggml/743)UEXTM.com
2024-02-28ggml : make i-quants work with super-blocks of 64 (CPU,Metal) (#5760)Kawrakow
2024-02-27IQ4_XS: a 4.25 bpw quantization (#5747)Kawrakow
2024-02-27cuda : replace remaining shfl_xor with calls to warp_reduce functions (#5744)Engininja2
2024-02-26Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range...Kawrakow
2024-02-26CUDA: fix DEBUG_CUDA_MALLOC (#5729)Johannes Gäßler
2024-02-25code : normalize enum names (#5697)Georgi Gerganov
2024-02-24IQ3_S: a much better alternative to Q3_K (#5676)Kawrakow
2024-02-22ggml : always define ggml_fp16_t as uint16_t (#5666)Georgi Gerganov
2024-02-21IQ4_NL: 4-bit non-linear quants with blocks of 32 (#5590)Kawrakow
2024-02-19cuda : ignore peer access already enabled errors (#5597)slaren
2024-02-19ci : enable -Werror for CUDA builds (#5579)Georgi Gerganov
2024-02-19cuda, metal : fix nans in soft_max (#5574)slaren
2024-02-181.5 bit quantization (#5453)Kawrakow
2024-02-17ggml : add ALiBi support for ggml_soft_max_ext (#5488)Georgi Gerganov
2024-02-15cuda : print message when initialization fails (#5512)slaren
2024-02-11CUDA: mul_mat_vec_q tiling, refactor mul mat logic (#5434)Johannes Gäßler
2024-02-08CUDA: more warps for mmvq on NVIDIA (#5394)Johannes Gäßler
2024-02-07CUDA: fixed mmvq kernel for bs 2,3,4 and -sm row (#5386)Johannes Gäßler
2024-02-06CUDA: mul_mat_vec_q max. batch size 8 -> 4 (#5370)Johannes Gäßler
2024-02-06CUDA: mul_mat_vec_q for batch sizes > 1 (#5351)Johannes Gäßler
2024-02-01cuda : fix LLAMA_CUDA_F16 (#5262)slaren
2024-01-31llava : add MobileVLM support (#5132)JidongZhang-THU
2024-01-30sync : ggml (#0)Georgi Gerganov
2024-01-30`ggml_cuda_cpy` support for 4d tensors and float16->float32 upcasting (ggml/686)John Balis
2024-01-30SOTA 3-bit quants (#5196)Kawrakow
2024-01-28ggml : add Vulkan backend (#2059)0cc4m
2024-01-26cuda : fix tensor size calculation for non-split buffer (#5145)slaren
2024-01-24cuda : fix 2-bit quants on amd hip (#5105)Engininja2
2024-01-23CUDA: more info when no device code (#5088)Johannes Gäßler
2024-01-20cuda : fix compile error in jetson platform (#4975)Kylin
2024-01-17ggml : add IQ2 to test-backend-ops + refactoring (#4990)Georgi Gerganov
2024-01-16ggml : introduce GGML_CALL function annotation (#4850)Justine Tunney
2024-01-15cuda : fix dequantize kernel names (#4938)Georgi Gerganov
2024-01-15CUDA: faster dequantize kernels for Q4_0 and Q4_1 (#4938)Kawrakow
2024-01-12CUDA: faster q8_0 -> f16 dequantization (#4895)Johannes Gäßler
2024-01-12llama : ggml-backend integration (#4766)slaren
2024-01-12CUDA: fix softmax compile for old CUDA versions (#4862)Johannes Gäßler
2024-01-11ggml : SOTA 2-bit quants (add IQ2_XS) (#4856)Kawrakow
2024-01-11fix : cuda order of synchronization when setting a buffer (ggml/679)Erik Scholz
generated by cgit v1.2.3 (git 2.25.1) at 2026-01-08 19:14:45 +0000