diff options
| author | Pierrick Hymbert <pierrick.hymbert@gmail.com> | 2024-02-21 15:47:48 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-02-21 15:47:48 +0100 |
| commit | 1ecea255ebb70750b52688393f37a63606b90e3f (patch) | |
| tree | dcd38aa52b1876ba38c33c4531be2c694d5e5428 /examples/server/README.md | |
| parent | a00a35cef93e057eace8351a667d14d152a91ebc (diff) | |
server: health: fix race condition on slots data using tasks queue (#5634)
* server: health: fix race condition on slots data using tasks queue
* server: health:
* include_slots only if slots_endpoint
* fix compile warning task.target_id not initialized.
Diffstat (limited to 'examples/server/README.md')
| -rw-r--r-- | examples/server/README.md | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/examples/server/README.md b/examples/server/README.md index f6b9c740..6d9f96cd 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -140,6 +140,8 @@ node index.js - 200 -> `{"status": "no slot available", "slots_idle": 0, "slots_processing": 32}` if no slot are currently available. - 503 -> `{"status": "no slot available", "slots_idle": 0, "slots_processing": 32}` if the query parameter `fail_on_no_slot` is provided and no slot are currently available. + If the query parameter `include_slots` is passed, `slots` field will contain internal slots data except if `--slots-endpoint-disable` is set. + - **POST** `/completion`: Given a `prompt`, it returns the predicted completion. *Options:* |