diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2025-03-23 17:10:52 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2025-03-23 17:10:52 +0100 |
| commit | f9307d79071c2a1e8efe10ecb1e1304bf77c021a (patch) | |
| tree | aea9c988eafe137b9c172ef1a56b54bbf272d4cf /examples/sweep-bench/sweep-bench.cpp | |
| parent | 5a4855e61c05b0c54ecad3f4155074d8f344b6f6 (diff) | |
Improve DeepSeek batched processing speed (#282)
* Improve DeepSeek batched processing speed
* Revert the commented out section in iqk_mul_mat.cpp
It does have some benefit at long contexts.
---------
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'examples/sweep-bench/sweep-bench.cpp')
0 files changed, 0 insertions, 0 deletions