diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2024-03-22 11:35:53 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-22 11:35:53 +0200 |
| commit | b3e94f26bab8e3b5338b5902e5af5bb01894cb4a (patch) | |
| tree | be09c2de020c766b8bd740e0172097a65dd7e7c2 /README.md | |
| parent | b2075fd6a578f5685060df4baa90ae9e48e98c70 (diff) | |
metal : proper assert for mat-mat memory alignment (#6225)
* metal : proper assert for mat-mat memory alignment
ggml-ci
* readme : add notice about the bug fix
* metal : fix the fix
ggml-ci
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 1 |
1 files changed, 1 insertions, 0 deletions
@@ -17,6 +17,7 @@ Inference of Meta's [LLaMA](https://arxiv.org/abs/2302.13971) model (and others) ### Hot topics +- Fix major bug in Metal batched inference https://github.com/ggerganov/llama.cpp/pull/6225 - Multi-GPU pipeline parallelizm support https://github.com/ggerganov/llama.cpp/pull/6017 - Looking for contributions to add Deepseek support: https://github.com/ggerganov/llama.cpp/issues/5981 - Quantization blind testing: https://github.com/ggerganov/llama.cpp/discussions/5962 |