diff options
| author | John Balis <phobossystems@gmail.com> | 2024-01-29 06:37:33 -0600 |
|---|---|---|
| committer | Georgi Gerganov <ggerganov@gmail.com> | 2024-01-30 16:20:25 +0200 |
| commit | 625a699b5456994bc32a8093d53818f60ceda6d1 (patch) | |
| tree | a2803e2bd4787418016e906886c2266d6b45293c /tests/test-quantize-fns.cpp | |
| parent | a4b07c057a553b1ac253051efc3f040351e2eae1 (diff) | |
`ggml_cuda_cpy` support for 4d tensors and float16->float32 upcasting (ggml/686)
* added cuda float16->float32 upcasting to ggml_cuda_cpy
* added ability to copy 4d tensors with the cuda backend
* added tests for float16_>float32 upcast and 4d tensor cuda copys
* added 4d copy test for float32->float16 copy
* applied patch suggested by @iamlemec
* simplify cpy tests
---------
Co-authored-by: slaren <slarengh@gmail.com>
Diffstat (limited to 'tests/test-quantize-fns.cpp')
0 files changed, 0 insertions, 0 deletions