diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-11-26 20:33:07 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-11-26 20:33:07 +0200 |
| commit | 922754a8d60080e956891f6cee1fb03aa48d57c6 (patch) | |
| tree | 8eeb7ba4e6f353ba2681a63f98536c27830c8f6d /examples/CMakeLists.txt | |
| parent | 22da05536ff4ad963080773bef1fb839fdab95d3 (diff) | |
lookahead : add example for lookahead decoding (#4207)
* lookahead : init
* lookahead : generate and store n-grams
* lookahead : use loop instead recursion to generate n-grams
* lookahead : initial working implementation
* lookahead : filter repeating n-grams
* lookahead : use deterministic init
* lookahead : add to Makefile
* lookahead : fix a bug in the seq_id of the lookahead tokens
* lookahead : add comments
---------
Co-authored-by: slaren <slarengh@gmail.com>
Diffstat (limited to 'examples/CMakeLists.txt')
| -rw-r--r-- | examples/CMakeLists.txt | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/examples/CMakeLists.txt b/examples/CMakeLists.txt index 71bcb689..6744944f 100644 --- a/examples/CMakeLists.txt +++ b/examples/CMakeLists.txt @@ -32,6 +32,7 @@ else() add_subdirectory(save-load-state) add_subdirectory(simple) add_subdirectory(speculative) + add_subdirectory(lookahead) add_subdirectory(train-text-from-scratch) if (LLAMA_METAL) add_subdirectory(metal) |