diff options
author | slaren <slarengh@gmail.com> | 2023-11-24 18:04:31 +0100 |
---|---|---|
committer | GitHub <noreply@github.com> | 2023-11-24 18:04:31 +0100 |
commit | 8a052c131ed3525313cdb84e5ae4e2b6cf8d2e24 (patch) | |
tree | 4c7f2e9a5929ac9db83c36a2cab588f3112798df /examples/server/server.cpp | |
parent | 189d68446e7ef21e8f3af3c0a3d91c35a39aec89 (diff) |
ggml-cuda : support stablelm rope (#4156)
* ggml-cuda : support stablelm rope
* remove unused freq_base kernel parameter
* add n_dims parameter to llm_build_k_shift, default to n_rot via overload
* llama : fix llm_build_k_shift args
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/server/server.cpp')
0 files changed, 0 insertions, 0 deletions