diff options
| author | Neo Zhang Jianyu <jianyu.zhang@intel.com> | 2024-03-02 19:49:30 +0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-02 19:49:30 +0800 |
| commit | 715641391dda1ff9762dc5d99d9a30acce99f2c6 (patch) | |
| tree | e57b359034b61f8d3ea4de372c2c3c0ec885c943 /common/common.cpp | |
| parent | 9bf297a02bfbd474e51912409a470dd797e2fe13 (diff) | |
Support multiple GPUs (split mode) on SYCL backend (#5806)
* suport multiple cards: split-mode - layer|row
* rm warning
* rebase with master, support tow new OPs, close feature for -sm=row, fix for unit test
* update news
* fix merge error
* update according to review comments
Diffstat (limited to 'common/common.cpp')
| -rw-r--r-- | common/common.cpp | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/common/common.cpp b/common/common.cpp index 938c428c..1c0b7c40 100644 --- a/common/common.cpp +++ b/common/common.cpp @@ -640,6 +640,10 @@ bool gpt_params_parse_ex(int argc, char ** argv, gpt_params & params) { } else if (arg_next == "layer") { params.split_mode = LLAMA_SPLIT_MODE_LAYER; } else if (arg_next == "row") { +#ifdef GGML_USE_SYCL + fprintf(stderr, "warning: The split mode value:[row] is not supported by llama.cpp with SYCL. It's developing.\nExit!\n"); + exit(1); +#endif // GGML_USE_SYCL params.split_mode = LLAMA_SPLIT_MODE_ROW; } else { invalid_param = true; |