diff options
| author | Iwan Kawrakow <iwan.kawrakow@gmail.com> | 2024-06-21 18:30:01 +0200 |
|---|---|---|
| committer | Iwan Kawrakow <iwan.kawrakow@gmail.com> | 2024-06-22 12:02:52 +0300 |
| commit | fc04994ebf8bfcb988a913cdd331bb120389bc44 (patch) | |
| tree | 809e62dbfa6cfbdd1845df24df8b4472778d7386 /examples/quantize | |
| parent | caa42ccc560d2c76addcdef8edcd0a570410e9f8 (diff) | |
iqk_mul_mat: add IQ4_NL also on NEON
PPL seems somewhat higher? For llama-v2-7B iwe are still
~0.04 higher compared to hat we expect after ~30 batches.
Diffstat (limited to 'examples/quantize')
0 files changed, 0 insertions, 0 deletions