diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2025-03-23 07:24:43 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2025-03-23 07:24:43 +0100 |
| commit | dd5ebd0e3d42e871ac398deaaa3f60edaa78a7eb (patch) | |
| tree | df6eabeff1f2f0fa7d6dd56e4fe7faaa9441b544 /common/common.h | |
| parent | 6028362ef6112c035001fef4313ab3697ef79a30 (diff) | |
Test transparent huge pages on Linux (#278)
* Adding ability to use THP on Linux
* Use the actual page size4 used for mmap also in munmap
* Add -thp to llama-bench
---------
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'common/common.h')
| -rw-r--r-- | common/common.h | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/common/common.h b/common/common.h index f6a55885..79c5fe96 100644 --- a/common/common.h +++ b/common/common.h @@ -194,6 +194,7 @@ struct gpt_params { bool warmup = true; // warmup run bool check_tensors = false; // validate tensor data bool repack_tensors = false; // repack tensors if interleaved variant is available + bool use_thp = false; // use transparent huge pages (linux only) std::string cache_type_k = "f16"; // KV cache data type for the K std::string cache_type_v = "f16"; // KV cache data type for the V |