diff options
| author | Nexes the Elder <124105151+Nexesenex@users.noreply.github.com> | 2024-10-18 09:48:15 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-10-18 09:48:15 +0200 |
| commit | 03cabe15401adba617c672ce8708a3501be8f15c (patch) | |
| tree | eda129c338de73c9c8e21a9b70eb9dc02480b3ad /ggml | |
| parent | 76b97c80645362ac65a2e33043fd8d46bdaf8c56 (diff) | |
CLI - Specify GGML_TYPE to quantize for the main tensors. (#91)
To complement the token_embd.weight and output.weight :
attn_v.weight
attn_k.weight.
attn_q_weight
attn_output.weight
attn_qkv.weight
ffn_gate
ffn_down
ffn_up
Diffstat (limited to 'ggml')
0 files changed, 0 insertions, 0 deletions