diff options
| author | Masaya, Kato <62578291+msy-kato@users.noreply.github.com> | 2024-06-04 00:14:15 +0900 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-06-03 17:14:15 +0200 |
| commit | a5735e4426b19a3ebd0c653ad8ac01420458ee95 (patch) | |
| tree | 992da9d6e702e105956d9c4e8d1bc3b93449da8d /examples/batched | |
| parent | 0b832d53ba0ffcc759c8d62ede3772dd62321f8e (diff) | |
ggml : use OpenMP as a thread pool (#7606)
* ggml: Added OpenMP for multi-threads processing
* ggml : Limit the number of threads used to avoid deadlock
* update shared state n_threads in parallel region
* clear numa affinity for main thread even with openmp
* enable openmp by default
* fix msvc build
* disable openmp on macos
* ci : disable openmp with thread sanitizer
* Update ggml.c
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
---------
Co-authored-by: slaren <slarengh@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/batched')
0 files changed, 0 insertions, 0 deletions