diff options
| author | Xuan Son Nguyen <thichthat@gmail.com> | 2024-01-26 13:42:20 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-26 14:42:20 +0200 |
| commit | 48c857aa10aea73210a4a72da3f1a6f99269e75d (patch) | |
| tree | 84ad3c5956c03c1bac8922f68ca828e456116b50 /examples/quantize-stats | |
| parent | 413e7b0559f922bd4de5e9eec548829d111651b1 (diff) | |
server : refactored the task processing logic (#5065)
* server: add llama_server_queue struct
* server: add llama_server_response_event
* server: add comments
* server: move all mutexes away from server.cpp
* server: correct multitask response
* server: only add back deferred tasks when one slot is available
* server: fix a race condition cause by "request_completion"
Diffstat (limited to 'examples/quantize-stats')
0 files changed, 0 insertions, 0 deletions