diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2025-05-12 07:47:46 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2025-05-12 07:47:46 +0300 |
| commit | 8669c3db2b98f05775292778dd05f424ee0cd250 (patch) | |
| tree | ed5c6a41e81ecd6b6620b748bfd765997663eb4c /ggml/include/ggml-backend.h | |
| parent | 504fb890d90ec27e5f4822b7bd772fa94d4d6aac (diff) | |
GPU offload policy (#405)
* Adding GPU offload policy
* Minor
---------
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'ggml/include/ggml-backend.h')
| -rw-r--r-- | ggml/include/ggml-backend.h | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/ggml/include/ggml-backend.h b/ggml/include/ggml-backend.h index 5f3f1e28..2975d43a 100644 --- a/ggml/include/ggml-backend.h +++ b/ggml/include/ggml-backend.h @@ -208,6 +208,9 @@ extern "C" { // Set a callback to be called for each resulting node during graph compute GGML_API void ggml_backend_sched_set_eval_callback(ggml_backend_sched_t sched, ggml_backend_sched_eval_callback callback, void * user_data); + // enable or disable op offload for a given op + GGML_API void ggml_backend_sched_set_op_offload(ggml_backend_sched_t sched, enum ggml_op op, bool on_or_off); + // // Utils // |