diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-11-26 20:33:07 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-11-26 20:33:07 +0200 |
| commit | 922754a8d60080e956891f6cee1fb03aa48d57c6 (patch) | |
| tree | 8eeb7ba4e6f353ba2681a63f98536c27830c8f6d /examples/speculative | |
| parent | 22da05536ff4ad963080773bef1fb839fdab95d3 (diff) | |
lookahead : add example for lookahead decoding (#4207)
* lookahead : init
* lookahead : generate and store n-grams
* lookahead : use loop instead recursion to generate n-grams
* lookahead : initial working implementation
* lookahead : filter repeating n-grams
* lookahead : use deterministic init
* lookahead : add to Makefile
* lookahead : fix a bug in the seq_id of the lookahead tokens
* lookahead : add comments
---------
Co-authored-by: slaren <slarengh@gmail.com>
Diffstat (limited to 'examples/speculative')
0 files changed, 0 insertions, 0 deletions