diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2024-10-01 14:46:40 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-10-01 14:46:40 +0300 |
| commit | e7f5a86a41ecd469e31b9d003acf91eff43b946f (patch) | |
| tree | 63aed20c449890a2c4a9896da76080cdb320ad5f /examples/pydantic_models_to_grammar.py | |
| parent | 8457a26f83b2f6acd014449e91bfb60a37fcec0e (diff) | |
IQ4_NL kv-cache on the CPU (Zen4/AVX2/ARM_NEON) (#74)
* Be able to use IQ4_NL for KV cache on AVX2/Zen4
* Be able to use IQ4_NL for KV cache on ARM_NEON
---------
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'examples/pydantic_models_to_grammar.py')
0 files changed, 0 insertions, 0 deletions