summaryrefslogtreecommitdiff
path: root/examples
AgeCommit message (Expand)Author
2024-04-27ci: server: tests python env on github container ubuntu latest / fix n_predic...Pierrick Hymbert
2024-04-26quantize: add imatrix and dataset metadata in GGUF (#6658)Pierrick Hymbert
2024-04-26server: stop generation at `n_ctx_train` if `n_predict` is not set (#6638)Pierrick Hymbert
2024-04-26bench: server add stop word for PHI-2 (#6916)Pierrick Hymbert
2024-04-25llava : add support for moondream vision language model (#6899)vik
2024-04-25clip : rename lerp function to avoid conflict (#6894)Daniel Bevenius
2024-04-25tests : minor bash stuff (#6902)Georgi Gerganov
2024-04-25quantize : add '--keep-split' to quantize model into shards (#6688)jiez
2024-04-24server : do not apply Markdown formatting in code sections (#6850)mgroeber9110
2024-04-24common : revert showing control tokens by default for server (#6860)Kyle Mistele
2024-04-24Server: fix seed for multiple slots (#6835)Johannes Gäßler
2024-04-21`build`: generate hex dump of server assets during build (#6661)Olivier Chafik
2024-04-21llama : add option to render special/control tokens (#6807)Georgi Gerganov
2024-04-21llava : use logger in llava-cli (#6797)Justine Tunney
2024-04-21llama : support Llama 3 HF conversion (#6745)Pedro Cuenca
2024-04-20doc : server tests require llama to be built with curl enabled (#6788)Jan Boon
2024-04-19server: static: upstream upgrade (#6765)Pierrick Hymbert
2024-04-19train : add general name (#6752)Austin
2024-04-18ggml : group all experts in a single ggml_mul_mat_id (#6505)slaren
2024-04-16ggml : add llamafile sgemm (#6414)Justine Tunney
2024-04-16gritlm : add --outdir option to hf.sh script (#6699)Daniel Bevenius
2024-04-16perplexity : require positive --ctx-size arg (#6695)Georgi Gerganov
2024-04-15`main`: add --json-schema / -j flag (#6659)Olivier Chafik
2024-04-15server : revert "minor layout improvements" (#6684)Pierrick Hymbert
2024-04-14Fix --split-max-size (#6655)Sigbjørn Skjæret
2024-04-14fix memcpy() crash, add missed cmd in guide, fix softmax (#6622)Neo Zhang Jianyu
2024-04-13model: support arch `DbrxForCausalLM` (#6515)Pierrick Hymbert
2024-04-12JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings,...Olivier Chafik
2024-04-12infill : add download instructions for model (#6626)Daniel Bevenius
2024-04-12server : coherent log output for KV cache full (#6637)Pierrick Hymbert
2024-04-12chore: Fix markdown warnings (#6625)Rene Leonhardt
2024-04-12imatrix : remove invalid assert (#6632)Georgi Gerganov
2024-04-12eval-callback: use ggml_op_desc to pretty print unary operator name (#6631)Pierrick Hymbert
2024-04-11As suggested by @slaren, disabling Metal for test to fix CI build on OSX from...Clint Herron
2024-04-11grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses...Olivier Chafik
2024-04-11eval-callback: Example how to use eval callback for debugging (#6576)Pierrick Hymbert
2024-04-10gguf : add option to not check tensor data (#6582)Daniel Bevenius
2024-04-10minor layout improvements (#6572)Ralph Soika
2024-04-09BERT tokenizer fixes (#6498)Jared Van Bortel
2024-04-09server : detect search query to start webchat (#6554)Ed Lee
2024-04-08llama : save and restore kv cache for single seq id (#6341)Jan Boon
2024-04-06ci: bench: support sse and fix prompt processing time / server: add tokens us...Pierrick Hymbert
2024-04-05bench : make n_batch and n_ubatch configurable in Batched bench (#6500)Ting Sun
2024-04-04server: allow penalizing repetition of newlines on server webpage (#6431)Shakhar Dasgupta
2024-04-04ci: bench: add more ftype, fix triggers and bot comment (#6466)Pierrick Hymbert
2024-04-04examples : add GBNF validator program (#5948)Clint Herron
2024-04-04server : remove obsolete --memory-f32 optionGeorgi Gerganov
2024-04-04server : add option to disable KV offload (#6468)Xiao-Yong Jin
2024-04-03A few small fixes to server's README docs (#6428)Fattire
2024-04-03server : handle exception on wrong type in request (#6452)JH23X