diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-10-11 21:25:33 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-10-11 21:25:33 +0300 |
| commit | 8c70a5ff25964f0a81e20d142a2f5ac5baff22fc (patch) | |
| tree | 50946ed36e647f5619b1866d77e3042d4d9743c5 /common/sampling.cpp | |
| parent | 24ba3d829e31a6eda3fa1723f692608c2fa3adda (diff) | |
batched : add bench tool (#3545)
* batched : add bench tool
* batched : minor fix table
* batched-bench : add readme + n_kv_max is now configurable
* batched-bench : init warm-up batch
* batched-bench : pass custom set of PP, TG and PL
* batched-bench : add mmq CLI arg
Diffstat (limited to 'common/sampling.cpp')
0 files changed, 0 insertions, 0 deletions