Age | Commit message (Collapse) | Author | |
---|---|---|---|
2024-02-11 | server : add llama2 chat template (#5425) | Xuan Son Nguyen | |
* server: add mistral chat template * server: fix typo * server: rename template mistral to llama2 * server: format_llama2: remove BOS * server: validate "--chat-template" argument * server: clean up using_chatml variable Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com> --------- Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com> | |||
2024-01-27 | sync : ggml | Georgi Gerganov | |
2024-01-26 | server : refactored the task processing logic (#5065) | Xuan Son Nguyen | |
* server: add llama_server_queue struct * server: add llama_server_response_event * server: add comments * server: move all mutexes away from server.cpp * server: correct multitask response * server: only add back deferred tasks when one slot is available * server: fix a race condition cause by "request_completion" |