diff options
| author | jukofyork <69222624+jukofyork@users.noreply.github.com> | 2024-05-08 01:24:16 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-05-08 02:24:16 +0200 |
| commit | 48b2f9c1fc71ab7df5432be2ed9fa7cdf5e8405e (patch) | |
| tree | 1b5458baebd1f6fb239ac01df636f7ee9123494d /examples/quantize/quantize.cpp | |
| parent | af0a5b616359809ce886ea433acedebb39b12969 (diff) | |
Fixed save_imatrix to match old behaviour for MoE (#7099)
* Fixed save_imatrix to match old behaviour for MoE
This fix is simple and clear, but unnecessarily doubles the memory overhead..
* Fixed missing idx variable
* Unconditionally increment ncall
Co-authored-by: slaren <slarengh@gmail.com>
* Fixed 2 bugs in save_imatrix()
- Fixed segfault bug because the counts vector needed to be created.
- Fixed pre-existing bug didn't actually add to the counts for "--combine" option.
* ncall needs summing too
* Trailing whitespace
---------
Co-authored-by: slaren <slarengh@gmail.com>
Diffstat (limited to 'examples/quantize/quantize.cpp')
0 files changed, 0 insertions, 0 deletions