diff options
| author | Kawrakow <48489457+ikawrakow@users.noreply.github.com> | 2024-01-14 09:45:56 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-14 09:45:56 +0200 |
| commit | 147b17ac94a24d524e367cda26a9ff6245689f34 (patch) | |
| tree | 6bae34826f82aa28a60ccb26de8eda0464774110 /examples/chat-persistent.sh | |
| parent | 807179ec583dcb882f97d9704577c06beb2c5ec9 (diff) | |
2-bit quantizations (#4897)
* imatrix: load
* imatrix: WIP
* imatrix: Add Q2_K quantization
* imatrix: also guard against Q2_K_S quantization without importance matrix
* imatrix: guard even more against low-bit quantization misuse
---------
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'examples/chat-persistent.sh')
0 files changed, 0 insertions, 0 deletions