diff options
| author | Johan <JohanAR@users.noreply.github.com> | 2024-05-08 14:27:58 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-05-08 15:27:58 +0300 |
| commit | 911b3900dded9a1cfe0f0e41b82c7a29baf3a217 (patch) | |
| tree | a47b29e640d55257399a20ac1632b12d58867f9c /examples/server/tests/features/server.feature | |
| parent | ad211edef5db1f1fb955874b7ca6a67bd0c88708 (diff) | |
server : add_special option for tokenize endpoint (#7059)
Diffstat (limited to 'examples/server/tests/features/server.feature')
| -rw-r--r-- | examples/server/tests/features/server.feature | 14 |
1 files changed, 13 insertions, 1 deletions
diff --git a/examples/server/tests/features/server.feature b/examples/server/tests/features/server.feature index 646a4e49..d21c0913 100644 --- a/examples/server/tests/features/server.feature +++ b/examples/server/tests/features/server.feature @@ -7,6 +7,7 @@ Feature: llama.cpp server And a model file tinyllamas/stories260K.gguf from HF repo ggml-org/models And a model file test-model.gguf And a model alias tinyllama-2 + And BOS token is 1 And 42 as server seed # KV Cache corresponds to the total amount of tokens # that can be stored across all independent sequences: #4130 @@ -91,7 +92,18 @@ Feature: llama.cpp server """ What is the capital of France ? """ - Then tokens can be detokenize + Then tokens can be detokenized + And tokens do not begin with BOS + + Scenario: Tokenize w/ BOS + Given adding special tokens + When tokenizing: + """ + What is the capital of Germany? + """ + Then tokens begin with BOS + Given first token is removed + Then tokens can be detokenized Scenario: Models available Given available models |