diff options
| author | Sergio López <slp@sinrega.org> | 2024-02-11 15:12:00 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-02-11 15:12:00 +0100 |
| commit | c88c74f967028ae3d5ebade40ae586d20a961abc (patch) | |
| tree | afe4a9a029be0a71dbe73222270081430ea33055 /gguf-py | |
| parent | a803333a4e6fc534c93afe90d741bc2388bdec87 (diff) | |
vulkan: only use M-sized matmul on Apple GPUs (#5412)
* vulkan: refactor guess_matmul_pipeline for vendor
Refactor ggml_vk_guess_matmul_pipeline to simplify adding per-vendor
conditionals.
Signed-off-by: Sergio Lopez <slp@redhat.com>
* vulkan: only use M-sized matmul on Apple GPUs
L-sized and S-sized matmuls are broken on Apple GPUs, force using
M-size with this vendor.
Signed-off-by: Sergio Lopez <slp@redhat.com>
---------
Signed-off-by: Sergio Lopez <slp@redhat.com>
Diffstat (limited to 'gguf-py')
0 files changed, 0 insertions, 0 deletions