diff options
| author | Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com> | 2024-04-12 10:52:36 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-04-12 10:52:36 +0200 |
| commit | 5c4d767ac028c0f9c31cba3fceaf765c6097abfc (patch) | |
| tree | c3b597785c67d07345e2c019bd6a0e1908df5aee /examples/quantize/README.md | |
| parent | ef21ce4ccb41164cb52997bd2210d92bc6a6c5d1 (diff) | |
chore: Fix markdown warnings (#6625)
Diffstat (limited to 'examples/quantize/README.md')
| -rw-r--r-- | examples/quantize/README.md | 22 |
1 files changed, 11 insertions, 11 deletions
diff --git a/examples/quantize/README.md b/examples/quantize/README.md index c8b9a27a..8a10365c 100644 --- a/examples/quantize/README.md +++ b/examples/quantize/README.md @@ -4,17 +4,17 @@ TODO ## Llama 2 7B -Quantization | Bits per Weight (BPW) --- | -- -Q2_K | 3.35 -Q3_K_S | 3.50 -Q3_K_M | 3.91 -Q3_K_L | 4.27 -Q4_K_S | 4.58 -Q4_K_M | 4.84 -Q5_K_S | 5.52 -Q5_K_M | 5.68 -Q6_K | 6.56 +| Quantization | Bits per Weight (BPW) | +|--------------|-----------------------| +| Q2_K | 3.35 | +| Q3_K_S | 3.50 | +| Q3_K_M | 3.91 | +| Q3_K_L | 4.27 | +| Q4_K_S | 4.58 | +| Q4_K_M | 4.84 | +| Q5_K_S | 5.52 | +| Q5_K_M | 5.68 | +| Q6_K | 6.56 | ## Llama 2 13B Quantization | Bits per Weight (BPW) |