diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2024-10-26 15:13:45 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-10-26 15:13:45 +0200 |
| commit | 3805c84686f40fc4423d45308cab6adac2eafdd4 (patch) | |
| tree | d753243884c6d45daf0c2cfd6c0c8e8afb625b00 /src/llama.cpp | |
| parent | f7b05a09ddb2b2579f6301a6223d894f5b97c494 (diff) | |
Improve Bitnet PP on Metal (#108)
iq1_bn goes from 702 t/s to 716 t/s
iq2_bn goes from 714 t/s to 743 t/s
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'src/llama.cpp')
0 files changed, 0 insertions, 0 deletions