diff options
| author | Iwan Kawrakow <iwan.kawrakow@gmail.com> | 2025-02-15 19:50:53 +0200 |
|---|---|---|
| committer | Iwan Kawrakow <iwan.kawrakow@gmail.com> | 2025-02-15 19:50:53 +0200 |
| commit | d44aba79ea9bea07c22cbf2336b51a37ba823524 (patch) | |
| tree | b78d88718aca28eab085ded6e6a1a87d7f4462c8 /examples/speculative | |
| parent | 0551e7630b2e74dfd140aadbf6a136c58199f474 (diff) | |
Bug fix in activation quantization
I added a change in the last PR how activations are quantized.
It looked like it is working and slightly improving performance.
But I now hit an edge case where I get gibberish that goes away if
I remove the change. I absolutely don't see what goes wrong, so
leaving the change in commented out for now.
Diffstat (limited to 'examples/speculative')
0 files changed, 0 insertions, 0 deletions