diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2025-03-27 05:49:16 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2025-03-27 05:49:16 +0100 |
| commit | d0b52076da0261f291b01f1ffa44884c8b2cdb1c (patch) | |
| tree | 93abea8ae30140fbd6733af91eede57c2243e91d /ggml/src/ggml-backend-impl.h | |
| parent | a22250df93fd833a6cb7f310b159ad1b54e4d582 (diff) | |
Use bf16 instead of fp16 block scales for q8_1 (#292)
* WIP - not working
* q8_0 without bells and wistles works
* It works for q8_0
* Use bf16 instead of f16,int16
* q4_0_r8
* q5_0_r4
* q6_0_r4
* Also q4_1 and q5_1
* q8_0_r8 on avx2
---------
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'ggml/src/ggml-backend-impl.h')
0 files changed, 0 insertions, 0 deletions