diff options
author | Kerfuffle <44031344+KerfuffleV2@users.noreply.github.com> | 2023-10-28 05:54:24 -0600 |
---|---|---|
committer | GitHub <noreply@github.com> | 2023-10-28 14:54:24 +0300 |
commit | bd6d9e205982b34e0ba2c3b22bbf31a1ef1a1bb5 (patch) | |
tree | 6fad32920bf28081145c17cddf5f7597e3a0b2f6 /examples/server/json-schema-to-grammar.mjs.hpp | |
parent | ee1a0ec9cb367ba41d138134795cbbbe93d2bf1c (diff) |
llama : allow quantizing k-quants to fall back when tensor size incompatible (#3747)
* Allow quantizing k-quants to fall back when tensor size incompatible
* quantizing: Add warning when tensors were incompatible with k-quants
Clean up k-quants state passing a bit
Diffstat (limited to 'examples/server/json-schema-to-grammar.mjs.hpp')
0 files changed, 0 insertions, 0 deletions