summaryrefslogtreecommitdiff
path: root/examples
AgeCommit message (Expand)Author
2024-03-14embedding : print all resulting embeddings (#899)Georgi Gerganov
2024-03-14embedding : print cosine similarity (#899)Georgi Gerganov
2024-03-13llama : add pipeline parallelism support (#6017)slaren
2024-03-13Server: Use multi-task for embeddings endpoint (#6001)Xuan Son Nguyen
2024-03-11llama : more consistent names of count variables (#5994)Georgi Gerganov
2024-03-11Update server docker image URLs (#5997)Jakub N
2024-03-11Server: format error to json (#5961)Xuan Son Nguyen
2024-03-11server : maintain chat completion id for streaming responses (#5988)Minsoo Cheong
2024-03-10android : fix utf8 decoding error (#5935)Dean
2024-03-10server: ci: windows build and tests (#5968)Pierrick Hymbert
2024-03-10llama : add support for GritLM (#5959)DAN™
2024-03-09server: benchmark: chat/completions scenario and other llm servers comparison...Pierrick Hymbert
2024-03-09server : print chat template infoGeorgi Gerganov
2024-03-09perplexity : support using multiple sequences to allow larger batch sizes (#5...slaren
2024-03-09server : fix metrics init (#5964)Georgi Gerganov
2024-03-09ggml : remove old quantization functions (#5942)Georgi Gerganov
2024-03-09server : clarify some items in the readme (#5957)Georgi Gerganov
2024-03-09server : normalize embeddings (#5956)SeungWon Jeong
2024-03-09server : fix passing prompt as tokens (#5955)Alexey Parfenov
2024-03-09server : simplify logic for empty prompts (#5953)Georgi Gerganov
2024-03-09Server: reorganize some http logic (#5939)Xuan Son Nguyen
2024-03-09server : add SSL support (#5926)Gabe Goodhart
2024-03-09server: tests: add truncated prompt tests, better kv cache size (#5933)Pierrick Hymbert
2024-03-08llama : support Mamba Selective State Space Models (#5328)compilade
2024-03-08server: metrics: add llamacpp:prompt_seconds_total and llamacpp:tokens_predic...Pierrick Hymbert
2024-03-08server : fix EOS token detection with disabled cache (#5938)Georgi Gerganov
2024-03-07llama-bench : add embeddings option (#5924)Georgi Gerganov
2024-03-07server : add `/v1/completions` endpoint (#5914)Minsoo Cheong
2024-03-07server : refactor (#5882)Georgi Gerganov
2024-03-04fix speculative decoding build on windows (#5874)Jeffrey Quesnelle
2024-03-04llama : fix embeddings (#5796)Georgi Gerganov
2024-03-04speculative : implement stochastic speculative sampling (#5625)Minsoo Cheong
2024-03-04add alias for chat template (#5858)Xuan Son Nguyen
2024-03-04main : support special tokens as reverse/anti prompt (#5847)DAN™
2024-03-03server : init http requests thread pool with --parallel if set (#5836)Pierrick Hymbert
2024-03-02server: tests: passkey challenge / self-extend with context shift demo (#5832)Pierrick Hymbert
2024-03-02convert : automatically fall back to HfVocab if tokenizer.model doesn't exist...Jared Van Bortel
2024-03-02Support multiple GPUs (split mode) on SYCL backend (#5806)Neo Zhang Jianyu
2024-03-01server : remove api_like_OAI.py proxy script (#5808)Georgi Gerganov
2024-03-01llama : cleanup unused mmq flags (#5772)Pierrick Hymbert
2024-03-01server: allow to override threads server pool with --threads-http (#5794)Pierrick Hymbert
2024-03-01server : fix newlines in help (#5785)Georgi Gerganov
2024-02-29Server: normalize naming (#5779)Xuan Son Nguyen
2024-02-28server : hit Ctrl+C twice to exit (#5734)Xuan Son Nguyen
2024-02-28server : add "/chat/completions" alias for "/v1/...` (#5722)Jorge A
2024-02-27IQ4_XS: a 4.25 bpw quantization (#5747)Kawrakow
2024-02-27llama : fix defrag bugs + add parameter (#5735)Georgi Gerganov
2024-02-26fix server hangs on empty prompt (#5733)Xuan Son Nguyen
2024-02-26Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range...Kawrakow
2024-02-25server: tests - slow inference causes timeout on the CI (#5715)Pierrick Hymbert
generated by cgit v1.2.3 (git 2.25.1) at 2026-01-06 18:22:49 +0000