diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2024-05-29 20:17:31 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-05-29 20:17:31 +0300 |
| commit | fb76ec31a9914b7761c1727303ab30380fd4f05c (patch) | |
| tree | a0bcc5041d8cf3373ad853bea4befd0b96e098d4 /ggml-sycl.cpp | |
| parent | cce3dcffc5695bd24835f04e6080070a2a119873 (diff) | |
ggml : fix YARN + add tests + add asserts (#7617)
* tests : add rope tests
ggml-ci
* ggml : fixes (hopefully)
ggml-ci
* tests : add non-cont tests
ggml-ci
* cuda : add asserts for rope/norm + fix DS2
ggml-ci
* ggml : assert contiguousness
* tests : reduce RoPE tests
ggml-ci
Diffstat (limited to 'ggml-sycl.cpp')
| -rw-r--r-- | ggml-sycl.cpp | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/ggml-sycl.cpp b/ggml-sycl.cpp index a7344813..5cd97e4f 100644 --- a/ggml-sycl.cpp +++ b/ggml-sycl.cpp @@ -15183,7 +15183,7 @@ static void ggml_sycl_mul_mat_batched_sycl(const ggml_tensor *src0, const int64_t r2 = ne12/ne02; const int64_t r3 = ne13/ne03; - if (r2 == 1 && r3 == 1 && src0->nb[2]*src0->ne[2] == src0->nb[3] && src1->nb[2]*src1->ne[2] == src1->nb[3]) { + if (r2 == 1 && r3 == 1 && ggml_is_contiguous_2(src0) && ggml_is_contiguous_2(src1)) { // there is no broadcast and src0, src1 are contiguous across dims 2, 3 SYCL_CHECK(CHECK_TRY_ERROR(dpct::gemm_batch( *g_sycl_handles[g_main_device], oneapi::mkl::transpose::trans, |