summaryrefslogtreecommitdiff
path: root/examples/server/server.cpp
AgeCommit message (Expand)Author
2024-03-09Server: reorganize some http logic (#5939)Xuan Son Nguyen
2024-03-09server : add SSL support (#5926)Gabe Goodhart
2024-03-09server: tests: add truncated prompt tests, better kv cache size (#5933)Pierrick Hymbert
2024-03-08llama : support Mamba Selective State Space Models (#5328)compilade
2024-03-08server: metrics: add llamacpp:prompt_seconds_total and llamacpp:tokens_predic...Pierrick Hymbert
2024-03-08server : fix EOS token detection with disabled cache (#5938)Georgi Gerganov
2024-03-07server : add `/v1/completions` endpoint (#5914)Minsoo Cheong
2024-03-07server : refactor (#5882)Georgi Gerganov
2024-03-04llama : fix embeddings (#5796)Georgi Gerganov
2024-03-04add alias for chat template (#5858)Xuan Son Nguyen
2024-03-03server : init http requests thread pool with --parallel if set (#5836)Pierrick Hymbert
2024-03-02server: tests: passkey challenge / self-extend with context shift demo (#5832)Pierrick Hymbert
2024-03-01llama : cleanup unused mmq flags (#5772)Pierrick Hymbert
2024-03-01server: allow to override threads server pool with --threads-http (#5794)Pierrick Hymbert
2024-03-01server : fix newlines in help (#5785)Georgi Gerganov
2024-02-29Server: normalize naming (#5779)Xuan Son Nguyen
2024-02-28server : hit Ctrl+C twice to exit (#5734)Xuan Son Nguyen
2024-02-28server : add "/chat/completions" alias for "/v1/...` (#5722)Jorge A
2024-02-26fix server hangs on empty prompt (#5733)Xuan Son Nguyen
2024-02-25llama : refactor k-shift implementation + KV defragmentation (#5691)Georgi Gerganov
2024-02-25server : fix crash when system prompt is bigger than batch size (#5714)compilade
2024-02-25server: logs - unified format and --log-format option (#5700)Pierrick Hymbert
2024-02-25server: concurrency fix + monitoring - add /metrics prometheus compatible end...Pierrick Hymbert
2024-02-25code : normalize enum names (#5697)Georgi Gerganov
2024-02-24server: continue to update other slots on embedding concurrent request (#5699)Pierrick Hymbert
2024-02-24server: init functional tests (#5566)Pierrick Hymbert
2024-02-23server : add KV cache quantization options (#5684)AlpinDale
2024-02-22server : fallback to chatml, add AlphaMonarch chat template (#5628)Xuan Son Nguyen
2024-02-21examples : do not assume BOS when shifting context (#5622)Jared Van Bortel
2024-02-21server: health: fix race condition on slots data using tasks queue (#5634)Pierrick Hymbert
2024-02-20server : support llava 1.6 (#5553)CJ Pais
2024-02-20Server: use llama_chat_apply_template (#5593)Xuan Son Nguyen
2024-02-20server : health endpoint configurable failure on no slot (#5594)Pierrick Hymbert
2024-02-18common, server : surface min_keep as its own parameter (#5567)Robey Holderith
2024-02-18server : slots monitoring endpoint (#5550)Pierrick Hymbert
2024-02-18server : enhanced health endpoint (#5548)Pierrick Hymbert
2024-02-18server : --n-predict option document and cap to max value (#5549)Pierrick Hymbert
2024-02-18server : graceful server shutdown (#5244)Daniel Hiltgen
2024-02-16server : add "samplers" param to control the samplers order (#5494)Alexey Parfenov
2024-02-16server : fix system prompt cli (#5516)Rőczey Barnabás
2024-02-16ggml : add numa options (#5377)bmwl
2024-02-15llava : fix memory management bug (#5491)Elbios
2024-02-14llava : support v1.6 (#5267)John
2024-02-11server : allow to specify tokens as strings in logit_bias (#5003)Alexey Parfenov
2024-02-11server : add llama2 chat template (#5425)Xuan Son Nguyen
2024-02-09server : fix prompt caching for repeated prompts (#5420)Riley Stewart
2024-02-07server : update `/props` with "total_slots" value (#5373)Justin Parker
2024-02-06server : remove model.json endpoint (#5371)Alexey Parfenov
2024-02-06server : include total "num_slots" in props endpoint (#5349)Justin Parker
2024-02-06server : add `dynatemp_range` and `dynatemp_exponent` (#5352)Michael Coppola
generated by cgit v1.2.3 (git 2.25.1) at 2025-08-16 23:03:44 +0000