diff options
author | 0cc4m <picard12@live.de> | 2024-06-16 07:17:31 +0200 |
---|---|---|
committer | GitHub <noreply@github.com> | 2024-06-16 07:17:31 +0200 |
commit | 7c7836d9d4062d6858e3fb337b135c417ccee6ce (patch) | |
tree | c896967a106e2985763bf1c7bfd7bfb8cbe4f0fd /vulkan-shaders/copy.comp | |
parent | 0c7b3595b9e5ad2355818e259f06b0dc3f0065b3 (diff) |
Vulkan Shader Refactor, Memory Debugging Option (#7947)
* Refactor shaders, extract GLSL code from ggml_vk_generate_shaders.py into vulkan-shaders directory
* Improve debug log code
* Add memory debug output option
* Fix flake8
* Fix unnecessary high llama-3 VRAM use
Diffstat (limited to 'vulkan-shaders/copy.comp')
-rw-r--r-- | vulkan-shaders/copy.comp | 16 |
1 files changed, 16 insertions, 0 deletions
diff --git a/vulkan-shaders/copy.comp b/vulkan-shaders/copy.comp new file mode 100644 index 00000000..efb55876 --- /dev/null +++ b/vulkan-shaders/copy.comp @@ -0,0 +1,16 @@ +#version 450 + +#include "types.comp" +#include "generic_unary_head.comp" + +void main() { + if (gl_GlobalInvocationID.x >= p.ne) { + return; + } + +#ifndef OPTIMIZATION_ERROR_WORKAROUND + data_d[p.d_offset + dst_idx(gl_GlobalInvocationID.x)] = D_TYPE(data_a[src0_idx(gl_GlobalInvocationID.x)]); +#else + data_d[p.d_offset + dst_idx(gl_GlobalInvocationID.x)] = data_a[src0_idx(gl_GlobalInvocationID.x)]; +#endif +} |