diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-10-11 21:25:33 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-10-11 21:25:33 +0300 |
| commit | 8c70a5ff25964f0a81e20d142a2f5ac5baff22fc (patch) | |
| tree | 50946ed36e647f5619b1866d77e3042d4d9743c5 /examples/CMakeLists.txt | |
| parent | 24ba3d829e31a6eda3fa1723f692608c2fa3adda (diff) | |
batched : add bench tool (#3545)
* batched : add bench tool
* batched : minor fix table
* batched-bench : add readme + n_kv_max is now configurable
* batched-bench : init warm-up batch
* batched-bench : pass custom set of PP, TG and PL
* batched-bench : add mmq CLI arg
Diffstat (limited to 'examples/CMakeLists.txt')
| -rw-r--r-- | examples/CMakeLists.txt | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/examples/CMakeLists.txt b/examples/CMakeLists.txt index de4cf7a6..ab845937 100644 --- a/examples/CMakeLists.txt +++ b/examples/CMakeLists.txt @@ -25,6 +25,7 @@ else() add_subdirectory(convert-llama2c-to-ggml) add_subdirectory(simple) add_subdirectory(batched) + add_subdirectory(batched-bench) add_subdirectory(speculative) add_subdirectory(parallel) add_subdirectory(embd-input) |