summaryrefslogtreecommitdiff
path: root/examples/server/utils.hpp
AgeCommit message (Collapse)Author
2024-01-27sync : ggmlGeorgi Gerganov
2024-01-26server : refactored the task processing logic (#5065)Xuan Son Nguyen
* server: add llama_server_queue struct * server: add llama_server_response_event * server: add comments * server: move all mutexes away from server.cpp * server: correct multitask response * server: only add back deferred tasks when one slot is available * server: fix a race condition cause by "request_completion"