diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-10-28 12:06:08 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-10-28 12:06:08 +0300 |
| commit | fdee152e4eebb78c191df0b074857111d7f2aba7 (patch) | |
| tree | 592d3c3cd7a1bdd3062682b7d1e49a6dde5491d1 /common/sampling.cpp | |
| parent | 41aee4df821854f37d90a45281f03b6db8d27de2 (diff) | |
starcoder : add GPU offloading (#3827)
* starcoder : do not GPU split 1D bias tensors
* starcoder : offload layers to GPU
ggml-ci
Diffstat (limited to 'common/sampling.cpp')
0 files changed, 0 insertions, 0 deletions