diff options
author | Georgi Gerganov <ggerganov@gmail.com> | 2024-05-22 11:01:35 +0300 |
---|---|---|
committer | GitHub <noreply@github.com> | 2024-05-22 11:01:35 +0300 |
commit | 3e5faa85032ec3106a2ad831bf412be9ff139f47 (patch) | |
tree | dc85a6e015eecb4c771bffd6d3c4202459edaa9a /ggml.h | |
parent | 201cc11afa0a1950e1f632390b2ac6c937a0d8f0 (diff) |
cuda : fix rope + add tests (#7452)
* cuda : fix rope pos data
ggml-ci
* ggml : drop mode & 1 == 1 support for ggml_rope
ggml-ci
* ggml : support freq_factors for f16 rope (CPU)
ggml-ci
* tests : add rope tests using frequency factors
ggml-ci
Diffstat (limited to 'ggml.h')
-rw-r--r-- | ggml.h | 2 |
1 files changed, 1 insertions, 1 deletions
@@ -1460,7 +1460,7 @@ extern "C" { struct ggml_tensor * b); // rotary position embedding - // if mode & 1 == 1, skip n_past elements (DEPRECATED) + // if mode & 1 == 1, skip n_past elements (NOT SUPPORTED) // if mode & 2 == 1, GPT-NeoX style // if mode & 4 == 1, ChatGLM style // |