diff options
| author | Iwan Kawrakow <iwan.kawrakow@gmail.com> | 2024-06-17 18:51:00 +0200 |
|---|---|---|
| committer | Iwan Kawrakow <iwan.kawrakow@gmail.com> | 2024-06-22 12:02:52 +0300 |
| commit | 1de6476d751a02978b035feb38066462c4382877 (patch) | |
| tree | 56957851a3b91eb09100d0284bbda8e976723ade /ggml-cuda/template-instances | |
| parent | f97a3296387c3fd0ac96324263cecc3d84edfd43 (diff) | |
bitnet 2 bpw: NEON implementation
We get PP-512 = 190 t/s and TG-128 = 75 t/s.
2 bpw TG on the CPU beats 1.75 bpw on the GPU!
Diffstat (limited to 'ggml-cuda/template-instances')
0 files changed, 0 insertions, 0 deletions