diff options
| author | Iwan Kawrakow <iwan.kawrakow@gmail.com> | 2024-06-04 17:24:04 +0300 |
|---|---|---|
| committer | Iwan Kawrakow <iwan.kawrakow@gmail.com> | 2024-06-22 12:02:49 +0300 |
| commit | 61b8cc1ff6105c6e82e2e71b68a3206bdf84bdfc (patch) | |
| tree | 7a999b1aac5cdcd8c2d00f9cf53a258625844c23 /examples/train-text-from-scratch/train-text-from-scratch.cpp | |
| parent | 2a72d9f978dc400b0df2bbafe1a73a2ec88e0701 (diff) | |
iqk_mul_mat: small improvement for iq3_s
The same as in llamafile. We get
PP-512 = 96.6 t/s
TG-128 = 7.77 t/s @ 4 threads
14.4 t/s @ 8 threads
16.3 t/s @ 16 threads
Diffstat (limited to 'examples/train-text-from-scratch/train-text-from-scratch.cpp')
0 files changed, 0 insertions, 0 deletions