diff options
author | Pierrick Hymbert <pierrick.hymbert@gmail.com> | 2024-02-24 19:16:04 +0100 |
---|---|---|
committer | GitHub <noreply@github.com> | 2024-02-24 19:16:04 +0100 |
commit | 9e359a4f47c1b2dceb99e29706c9f7403d32ab5e (patch) | |
tree | aa491d0744940ccce9ff69fe1bcc9e1f16b7a1ff /examples/server/server.cpp | |
parent | 4c4cb30736582cacb1a164a9d4bc8e17b1014be7 (diff) |
server: continue to update other slots on embedding concurrent request (#5699)
* server: #5655 - continue to update other slots on embedding concurrent request.
* server: tests: add multi users embeddings as fixed
* server: tests: adding OAI compatible embedding concurrent endpoint
* server: tests: adding OAI compatible embedding with multiple inputs
Diffstat (limited to 'examples/server/server.cpp')
-rw-r--r-- | examples/server/server.cpp | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/examples/server/server.cpp b/examples/server/server.cpp index 9fb436c2..19a8c106 100644 --- a/examples/server/server.cpp +++ b/examples/server/server.cpp @@ -1836,7 +1836,7 @@ struct llama_server_context send_embedding(slot); slot.release(); slot.i_batch = -1; - return true; + continue; } completion_token_output result; |