diff options
| author | slaren <slarengh@gmail.com> | 2023-08-18 12:44:58 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-08-18 12:44:58 +0200 |
| commit | 097e121e2f17ed3541cf02c55ff7e9febc091b19 (patch) | |
| tree | f3bead40b2632be95479e3f9b31baffc6681f572 /examples/server/chat.mjs | |
| parent | eaf98c2649d7da705de255712f0038ac7e47c610 (diff) | |
llama : add benchmark example (#2626)
* llama : add benchmark example
* add to examples CMakeLists.txt
* fix msvc build
* add missing include
* add Bessel's correction to stdev calculation
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
* improve markdown formatting
* add missing include
* print warning is NDEBUG is not defined
* remove n_prompt and n_gen from the matrix, use each value separately instead
* better checks for non-optimized builds
* llama.cpp : fix MEM_REQ_SCRATCH0 reusing the value of n_ctx of the first call
* fix json formatting
* add sql output
* add basic cpu and gpu info (linx/cuda only)
* markdown: also show values that differ from the default
* markdown: add build id
* cleanup
* improve formatting
* formatting
---------
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
Diffstat (limited to 'examples/server/chat.mjs')
0 files changed, 0 insertions, 0 deletions