diff options
| author | slaren <slarengh@gmail.com> | 2023-08-18 12:44:58 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-08-18 12:44:58 +0200 |
| commit | 097e121e2f17ed3541cf02c55ff7e9febc091b19 (patch) | |
| tree | f3bead40b2632be95479e3f9b31baffc6681f572 /examples/llama-bench/CMakeLists.txt | |
| parent | eaf98c2649d7da705de255712f0038ac7e47c610 (diff) | |
llama : add benchmark example (#2626)
* llama : add benchmark example
* add to examples CMakeLists.txt
* fix msvc build
* add missing include
* add Bessel's correction to stdev calculation
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
* improve markdown formatting
* add missing include
* print warning is NDEBUG is not defined
* remove n_prompt and n_gen from the matrix, use each value separately instead
* better checks for non-optimized builds
* llama.cpp : fix MEM_REQ_SCRATCH0 reusing the value of n_ctx of the first call
* fix json formatting
* add sql output
* add basic cpu and gpu info (linx/cuda only)
* markdown: also show values that differ from the default
* markdown: add build id
* cleanup
* improve formatting
* formatting
---------
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
Diffstat (limited to 'examples/llama-bench/CMakeLists.txt')
| -rw-r--r-- | examples/llama-bench/CMakeLists.txt | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/examples/llama-bench/CMakeLists.txt b/examples/llama-bench/CMakeLists.txt new file mode 100644 index 00000000..7e395afd --- /dev/null +++ b/examples/llama-bench/CMakeLists.txt @@ -0,0 +1,8 @@ +set(TARGET llama-bench) +add_executable(${TARGET} llama-bench.cpp) +install(TARGETS ${TARGET} RUNTIME) +target_link_libraries(${TARGET} PRIVATE common llama ${CMAKE_THREAD_LIBS_INIT}) +target_compile_features(${TARGET} PRIVATE cxx_std_11) +if(TARGET BUILD_INFO) + add_dependencies(${TARGET} BUILD_INFO) +endif() |