diff options
| author | Reinforce-II <fate@eastal.com> | 2024-01-22 21:15:08 +0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-22 15:15:08 +0200 |
| commit | 780e24a22eb595b705cbe8284771e9ceff1c4dd2 (patch) | |
| tree | 0c11cc73dc7bf38e3978428eebf6ca224c551d56 /examples/perplexity | |
| parent | 3ce7e8f8e7ccfce07e5947ac5f1f3f4628cf68ea (diff) | |
ggml : parallelize FP32 conversion when using BLAS (#5045)
* make GGML_TASK_INIT phase can be run in multithread
* multithreaded dequantize in mul_mat when using blas library
* minor fixes
* update outdated comment
* fix coding style
* simplify code
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/perplexity')
0 files changed, 0 insertions, 0 deletions