diff options
| author | 0cc4m <picard12@live.de> | 2024-01-31 11:44:19 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-31 11:44:19 +0100 |
| commit | f8e9140cb46eebaa867e1184a9946e4840eec772 (patch) | |
| tree | 24cad8b37084d2d77d78e431047d286a6946de09 /ggml_vk_generate_shaders.py | |
| parent | d62520eb2cc1d7168a30edec6110e1daefbd959f (diff) | |
Vulkan Fixes (#5223)
* Fix Vulkan F16 models
* Fix Vulkan context shift crash
* Add Vulkan to common.cpp dump_non_result_info_yaml function
* Fix bug in Vulkan CPY op
* Fix small matrix multiplication errors in AMD GPUs on Windows or with amdvlk
Co-authored-by: Engininja2 <139037756+Engininja2@users.noreply.github.com>
---------
Co-authored-by: Engininja2 <139037756+Engininja2@users.noreply.github.com>
Diffstat (limited to 'ggml_vk_generate_shaders.py')
| -rw-r--r-- | ggml_vk_generate_shaders.py | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/ggml_vk_generate_shaders.py b/ggml_vk_generate_shaders.py index d0861fde..6b1b82bf 100644 --- a/ggml_vk_generate_shaders.py +++ b/ggml_vk_generate_shaders.py @@ -19,8 +19,8 @@ shader_int8_ext = """ # Type-specific defines shader_f16_defines = """ -#define QUANT_K 32 -#define QUANT_R 2 +#define QUANT_K 1 +#define QUANT_R 1 #define A_TYPE float16_t """ |