summaryrefslogtreecommitdiff
path: root/examples/server
AgeCommit message (Expand)Author
2024-05-08convert-hf : save memory with lazy evaluation (#7075)compilade
2024-05-08JSON: [key] -> .at(key), assert() -> GGML_ASSERT (#7143)Johannes Gäßler
2024-05-08server : add themes + favicon (#6848)JohnnyB
2024-05-08server : add_special option for tokenize endpoint (#7059)Johan
2024-05-08clean up json_value & server_log (#7142)Xuan Son Nguyen
2024-05-07server: fix incorrectly reported token probabilities (#7125)Johannes Gäßler
2024-05-07server : update readme with undocumented options (#7013)Kyle Mistele
2024-05-04If first token generated from the server is the stop word the server will cra...maor-ps
2024-05-01Server: add tests for batch size, different seeds (#6950)Johannes Gäßler
2024-04-30ggml : add Flash Attention (#5021)Georgi Gerganov
2024-04-30Improve usability of --model-url & related flags (#6930)Olivier Chafik
2024-04-29build(cmake): simplify instructions (`cmake -B build && cmake --build build ....Olivier Chafik
2024-04-27ci: server: tests python env on github container ubuntu latest / fix n_predic...Pierrick Hymbert
2024-04-26quantize: add imatrix and dataset metadata in GGUF (#6658)Pierrick Hymbert
2024-04-26server: stop generation at `n_ctx_train` if `n_predict` is not set (#6638)Pierrick Hymbert
2024-04-26bench: server add stop word for PHI-2 (#6916)Pierrick Hymbert
2024-04-25tests : minor bash stuff (#6902)Georgi Gerganov
2024-04-24server : do not apply Markdown formatting in code sections (#6850)mgroeber9110
2024-04-24common : revert showing control tokens by default for server (#6860)Kyle Mistele
2024-04-24Server: fix seed for multiple slots (#6835)Johannes Gäßler
2024-04-21`build`: generate hex dump of server assets during build (#6661)Olivier Chafik
2024-04-21llama : support Llama 3 HF conversion (#6745)Pedro Cuenca
2024-04-20doc : server tests require llama to be built with curl enabled (#6788)Jan Boon
2024-04-19server: static: upstream upgrade (#6765)Pierrick Hymbert
2024-04-15`main`: add --json-schema / -j flag (#6659)Olivier Chafik
2024-04-15server : revert "minor layout improvements" (#6684)Pierrick Hymbert
2024-04-12JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings,...Olivier Chafik
2024-04-12server : coherent log output for KV cache full (#6637)Pierrick Hymbert
2024-04-10minor layout improvements (#6572)Ralph Soika
2024-04-09BERT tokenizer fixes (#6498)Jared Van Bortel
2024-04-09server : detect search query to start webchat (#6554)Ed Lee
2024-04-08llama : save and restore kv cache for single seq id (#6341)Jan Boon
2024-04-06ci: bench: support sse and fix prompt processing time / server: add tokens us...Pierrick Hymbert
2024-04-04server: allow penalizing repetition of newlines on server webpage (#6431)Shakhar Dasgupta
2024-04-04ci: bench: add more ftype, fix triggers and bot comment (#6466)Pierrick Hymbert
2024-04-04server : remove obsolete --memory-f32 optionGeorgi Gerganov
2024-04-04server : add option to disable KV offload (#6468)Xiao-Yong Jin
2024-04-03A few small fixes to server's README docs (#6428)Fattire
2024-04-03server : handle exception on wrong type in request (#6452)JH23X
2024-03-28server : stop gracefully on SIGTERM (#6348)Eric Zhang
2024-03-27server: continuous performance monitoring and PR comment (#6283)Pierrick Hymbert
2024-03-27server: public: use relative routes for static files (#6325)Eric Zhang
2024-03-26llama : greatly reduce output buffer memory usage (#6122)compilade
2024-03-26server : add `n_discard` parameter (#6300)Jan Boon
2024-03-26cuda : rename build flag to LLAMA_CUDA (#6299)slaren
2024-03-25Server: clean up OAI params parsing function (#6284)Xuan Son Nguyen
2024-03-23common: llama_load_model_from_url split support (#6192)Pierrick Hymbert
2024-03-23server: docs: `--threads` and `--threads`, `--ubatch-size`, `--log-disable` (...Pierrick Hymbert
2024-03-23server: flush stdout after logging in both text and json layout (#6253)Pierrick Hymbert
2024-03-22json-schema-to-grammar : fix order of props + non-str const/enum (#6232)Olivier Chafik
generated by cgit v1.2.3 (git 2.25.1) at 2026-01-02 19:51:28 +0000