diff options
| author | Kawrakow <48489457+ikawrakow@users.noreply.github.com> | 2024-09-05 07:48:27 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-09-05 07:48:27 +0300 |
| commit | 0087008d2999eea83f20fd17c775fdc5f8b4b6b5 (patch) | |
| tree | 7ba6769a659e4daa0d2f55d2ac219287a5dafac5 /include/llama.h | |
| parent | 7b1b2b2c06c1729139135c9e47611af7161de6f7 (diff) | |
Add support for bf16 to iqk_mul_mat (#39)
* WIP: adding BF16 support to iqk_mul_mat
* Minor
* Improve TG speed (when not memory bound)
---------
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'include/llama.h')
0 files changed, 0 insertions, 0 deletions