diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2025-05-12 07:50:26 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2025-05-12 07:50:26 +0300 |
| commit | 1d2da7feaee3e4dd1b78fb4108988c977b47e266 (patch) | |
| tree | 4449c9c892dde93d5b8cae1389454a0d099c581e /common/common.h | |
| parent | f27cd405422307e02dffa8949ac30bc56b4d2900 (diff) | |
Add batch warmup to sweep-bench (#375)
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'common/common.h')
| -rw-r--r-- | common/common.h | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/common/common.h b/common/common.h index fd83c9d3..1b4835bd 100644 --- a/common/common.h +++ b/common/common.h @@ -200,6 +200,7 @@ struct gpt_params { bool dump_kv_cache = false; // dump the KV cache contents for debugging purposes bool no_kv_offload = false; // disable KV offloading bool warmup = true; // warmup run + bool batch_warmup = false; // batch warmup run bool check_tensors = false; // validate tensor data bool repack_tensors = false; // repack tensors if interleaved variant is available bool use_thp = false; // use transparent huge pages (linux only) |