diff options
| author | slaren <slarengh@gmail.com> | 2024-03-09 19:55:54 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-09 19:55:54 +0100 |
| commit | d894f352bf433157232dc8dc54eacd50014e898e (patch) | |
| tree | 0ed89f222eb3f0e08a397c953d27e7e6846156ce /common | |
| parent | 098dbaab449f5309a54871ba7e5acef72ae696de (diff) | |
perplexity : support using multiple sequences to allow larger batch sizes (#5946)
* perplexity : support using multiple sequences to allow larger batch sizes
ggml-ci
* set cparams.n_parallel to the number of sequences
* print tested n_ctx, add assert
Diffstat (limited to 'common')
0 files changed, 0 insertions, 0 deletions