diff options
| author | agray3 <agray3@users.noreply.github.com> | 2024-05-27 18:33:42 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-05-27 19:33:42 +0200 |
| commit | 197c00681b80f9dea17d11a4436b6b8ef1be0ce8 (patch) | |
| tree | 300aaa9d0d9c3741f62a3e21bc0c041aef197410 /examples/server/utils.hpp | |
| parent | 95f84d5ce8b449a9b16009434aca800df504a02e (diff) | |
Allow multiple copy function pointers for CUDA graph kernel param updates (#7565)
CUDA graphs require parameter updates to kernels associated with
GGML_OP_CPY nodes. Previously the implementation only checked for a
single CUDA kernel in such nodes, but this caused a bug in cases where
2 such kernels exist. This fixes the issue by using a vector to allow
multiple function pointers to be stored and checked against.
Fixes #7942
Diffstat (limited to 'examples/server/utils.hpp')
0 files changed, 0 insertions, 0 deletions