summaryrefslogtreecommitdiff
path: root/examples/batched-bench/batched-bench.cpp
AgeCommit message (Collapse)Author
2023-10-11batched : add bench tool (#3545)Georgi Gerganov
* batched : add bench tool * batched : minor fix table * batched-bench : add readme + n_kv_max is now configurable * batched-bench : init warm-up batch * batched-bench : pass custom set of PP, TG and PL * batched-bench : add mmq CLI arg