diff options
| author | slaren <slarengh@gmail.com> | 2023-11-24 18:04:31 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-11-24 18:04:31 +0100 |
| commit | 8a052c131ed3525313cdb84e5ae4e2b6cf8d2e24 (patch) | |
| tree | 4c7f2e9a5929ac9db83c36a2cab588f3112798df /examples/server | |
| parent | 189d68446e7ef21e8f3af3c0a3d91c35a39aec89 (diff) | |
ggml-cuda : support stablelm rope (#4156)
* ggml-cuda : support stablelm rope
* remove unused freq_base kernel parameter
* add n_dims parameter to llm_build_k_shift, default to n_rot via overload
* llama : fix llm_build_k_shift args
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/server')
0 files changed, 0 insertions, 0 deletions