diff options
| author | Jan Boon <kaetemi@gmail.com> | 2024-03-22 06:41:24 +0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-21 23:41:24 +0100 |
| commit | be07a03217376c53b1d95e5f658adbbbb2831555 (patch) | |
| tree | a197fbe1f72d4c8dbb82b7f8336936703e815f64 /examples/server | |
| parent | d0a71233fbf8ade8ef06ad8e6b81d1d7b254895f (diff) | |
server : update readme doc from `slot_id` to `id_slot` (#6213)
Diffstat (limited to 'examples/server')
| -rw-r--r-- | examples/server/README.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/examples/server/README.md b/examples/server/README.md index 755e1d53..355601ff 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -260,7 +260,7 @@ node index.js `image_data`: An array of objects to hold base64-encoded image `data` and its `id`s to be reference in `prompt`. You can determine the place of the image in the prompt as in the following: `USER:[img-12]Describe the image in detail.\nASSISTANT:`. In this case, `[img-12]` will be replaced by the embeddings of the image with id `12` in the following `image_data` array: `{..., "image_data": [{"data": "<BASE64_STRING>", "id": 12}]}`. Use `image_data` only with multimodal models, e.g., LLaVA. - `slot_id`: Assign the completion task to an specific slot. If is -1 the task will be assigned to a Idle slot (default: -1) + `id_slot`: Assign the completion task to an specific slot. If is -1 the task will be assigned to a Idle slot (default: -1) `cache_prompt`: Re-use previously cached prompt from the last request if possible. This may prevent re-caching the prompt from scratch. (default: false) |