diff options
| author | Kawrakow <48489457+ikawrakow@users.noreply.github.com> | 2024-08-20 17:15:06 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-08-20 17:15:06 +0300 |
| commit | a325745000114a43c1546323f91720db503ed0a9 (patch) | |
| tree | bc695b57bba4136725e3cfc8c88b7779593ba909 /examples | |
| parent | a73702d93b1007b2f528432c3db20c7aa5206352 (diff) | |
iq4_k: use iq5_k also when n_gqa = 2 (#23)
This improves size vs quality balance for Gemma-2 models.
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'examples')
0 files changed, 0 insertions, 0 deletions