diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2025-04-15 17:05:31 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2025-04-15 17:05:31 +0200 |
| commit | 1bbb143eb36ce3f6b771fd4c0deb02826c0a7800 (patch) | |
| tree | 49fad63f7ccd581e8fe188f2781a0b48e88f11a1 /convert_hf_to_gguf.py | |
| parent | 05dbbeaf1489c55533adb5a032e077fab6cd95ad (diff) | |
Allow q8_0 KV cache for head size 256 (#330)
* Allow q8_0 KV cache for head size 256
* We need also these
---------
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'convert_hf_to_gguf.py')
0 files changed, 0 insertions, 0 deletions