diff options
| author | sasha0552 <admin@sasha0552.org> | 2024-06-08 07:50:31 +0000 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-06-08 10:50:31 +0300 |
| commit | 7a16ce7db2a74a223f0f3b9cee66d4539c5bce8f (patch) | |
| tree | f1235f9d8ee68d4c39403bd2bca1078062cab2d7 /common/common.h | |
| parent | da799b41891e34aac86ce4e173f9c4c0afd4fab3 (diff) | |
server : smart slot selection using Longest Common Prefix (#7728)
* server : Smart selection of available slot using Longest Common Substring
* add usage
* remove trailing whitespaces
* Use Longest Common Prefix (LCP) instead of LCS
* Rename argument
Diffstat (limited to 'common/common.h')
| -rw-r--r-- | common/common.h | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/common/common.h b/common/common.h index 35f5311e..038f9084 100644 --- a/common/common.h +++ b/common/common.h @@ -203,6 +203,8 @@ struct gpt_params { std::string slot_save_path; + float slot_prompt_similarity = 0.5f; + // batched-bench params bool is_pp_shared = false; |