diff options
| author | Neo Zhang Jianyu <jianyu.zhang@intel.com> | 2024-03-02 19:49:30 +0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-02 19:49:30 +0800 |
| commit | 715641391dda1ff9762dc5d99d9a30acce99f2c6 (patch) | |
| tree | e57b359034b61f8d3ea4de372c2c3c0ec885c943 /ggml-sycl.h | |
| parent | 9bf297a02bfbd474e51912409a470dd797e2fe13 (diff) | |
Support multiple GPUs (split mode) on SYCL backend (#5806)
* suport multiple cards: split-mode - layer|row
* rm warning
* rebase with master, support tow new OPs, close feature for -sm=row, fix for unit test
* update news
* fix merge error
* update according to review comments
Diffstat (limited to 'ggml-sycl.h')
| -rw-r--r-- | ggml-sycl.h | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/ggml-sycl.h b/ggml-sycl.h index 891f2d00..bf5b11b3 100644 --- a/ggml-sycl.h +++ b/ggml-sycl.h @@ -24,6 +24,11 @@ GGML_API ggml_backend_buffer_type_t ggml_backend_sycl_host_buffer_type(void); GGML_API void ggml_backend_sycl_print_sycl_devices(void); GGML_API GGML_CALL void ggml_sycl_get_gpu_list(int *id_list, int max_len); GGML_API GGML_CALL void ggml_sycl_get_device_description(int device, char *description, size_t description_size); +GGML_API GGML_CALL int ggml_backend_sycl_get_device_count(); +GGML_API GGML_CALL ggml_backend_buffer_type_t ggml_backend_sycl_split_buffer_type(const float * tensor_split); +GGML_API GGML_CALL void ggml_backend_sycl_get_device_memory(int device, size_t *free, size_t *total); +GGML_API GGML_CALL int ggml_backend_sycl_get_device_index(int device_id); + #ifdef __cplusplus } #endif |