diff options
| author | Kawrakow <48489457+ikawrakow@users.noreply.github.com> | 2024-01-18 19:18:21 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-18 19:18:21 +0200 |
| commit | 3e945cc1e9c06d2001031360e4e303e9548fb02c (patch) | |
| tree | 6e7468da2718a28a07026fd3d5d4c18edaa63bd6 /examples/imatrix | |
| parent | ad19812cda4062c9f154ef16315df41fbe6a770a (diff) | |
HellaSwag: speed up by parallelizing log-prob evaluation (#5020)
For Mistral-7B and fp16, time on my system goes down from 536 seconds
to 423 seconds for the full evaluation dataset (10042 tasks).
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'examples/imatrix')
0 files changed, 0 insertions, 0 deletions