diff options
| author | Kawrakow <48489457+ikawrakow@users.noreply.github.com> | 2024-01-17 12:36:37 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-17 12:36:37 +0200 |
| commit | 2b3a665d3917edf393761a24c4835447894df74a (patch) | |
| tree | 254942a7222314ac60c406842912ae092d724000 /examples/perplexity | |
| parent | 75632936659772d5b2ce54b0b65319fecbaac2e6 (diff) | |
llama : use Q4_K for attn_v for Q2_K_S when n_gqa >= 4 (#4996)
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'examples/perplexity')
0 files changed, 0 insertions, 0 deletions