diff options
| author | vvhg1 <94630311+vvhg1@users.noreply.github.com> | 2023-10-02 09:42:02 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-10-02 10:42:02 +0300 |
| commit | c97f01c362ac102c6994edb80008f8608539553a (patch) | |
| tree | c73baa81f489587329c3f768a3b940e353233012 /common | |
| parent | f5ef5cfb18148131fcf45bdd2331f0db5ab7c3d0 (diff) | |
infill : add new example + extend server API (#3296)
* vvhg-code-infill (#1)
* infill in separate example (#2)
* reverted changes to main and added infill example
* cleanup
* naming improvement
* make : add missing blank line
* fix missing semicolon
* brought infill up to current main code
* cleanup
---------
Co-authored-by: Cebtenzzre <cebtenzzre@gmail.com>
Diffstat (limited to 'common')
| -rw-r--r-- | common/common.cpp | 2 | ||||
| -rw-r--r-- | common/common.h | 1 |
2 files changed, 3 insertions, 0 deletions
diff --git a/common/common.cpp b/common/common.cpp index ec181c6b..4b233786 100644 --- a/common/common.cpp +++ b/common/common.cpp @@ -389,6 +389,8 @@ bool gpt_params_parse(int argc, char ** argv, gpt_params & params) { params.interactive_first = true; } else if (arg == "-ins" || arg == "--instruct") { params.instruct = true; + } else if (arg == "--infill") { + params.infill = true; } else if (arg == "--multiline-input") { params.multiline_input = true; } else if (arg == "--simple-io") { diff --git a/common/common.h b/common/common.h index 0e2d3fa6..e095c56e 100644 --- a/common/common.h +++ b/common/common.h @@ -120,6 +120,7 @@ struct gpt_params { bool use_mlock = false; // use mlock to keep model in memory bool numa = false; // attempt optimizations that help on some NUMA systems bool verbose_prompt = false; // print prompt tokens before generation + bool infill = false; // use infill mode }; bool gpt_params_parse(int argc, char ** argv, gpt_params & params); |