diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-09-03 15:12:08 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-09-03 15:12:08 +0300 |
| commit | 47068e517004d90f13c16352bb3b4cafd53a00cd (patch) | |
| tree | 259f1fb1184775dc250452d319c8006c0704ea22 /ggml-alloc.c | |
| parent | 8f429fa5111901f9646cf998643ac5310846d487 (diff) | |
speculative : PoC for speeding-up inference via speculative sampling (#2926)
* speculative : initial example
* speculative : print encoding speed
* speculative : add --draft CLI arg
Diffstat (limited to 'ggml-alloc.c')
0 files changed, 0 insertions, 0 deletions