diff options
| author | HanishKVC <hanishkvc@gmail.com> | 2024-05-10 15:51:58 +0530 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-05-10 20:21:58 +1000 |
| commit | f89fe2732c5709f6e86d5f4aee2e6d2a561f2eb2 (patch) | |
| tree | 4e427e6595de0d43d601c7781c16445297e5322f /common/common.h | |
| parent | d11afd665241c1b3910ab5f040d0216403019d87 (diff) | |
Main+: optionally allow special tokens from user in interactive mode (#7097)
@hanishkvc added a new `--interactive-specials` flag which would allow for inserting special tokens from user side into the embedding stream.
Diffstat (limited to 'common/common.h')
| -rw-r--r-- | common/common.h | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/common/common.h b/common/common.h index 6f00a2cc..d80344f2 100644 --- a/common/common.h +++ b/common/common.h @@ -140,6 +140,7 @@ struct gpt_params { bool random_prompt = false; // do not randomize prompt if none provided bool use_color = false; // use color to distinguish generations and inputs bool interactive = false; // interactive mode + bool interactive_specials = false; // whether to allow special tokens from user, during interactive mode bool conversation = false; // conversation mode (does not print special tokens and suffix/prefix) bool chatml = false; // chatml mode (used for models trained on chatml syntax) bool prompt_cache_all = false; // save user input and generations to prompt cache |