summaryrefslogtreecommitdiff
path: root/examples
AgeCommit message (Expand)Author
2024-08-07Adding IQ2_TN for use with ternary models (#13)Kawrakow
2024-08-05q2_K: allow it to detect ternary nets and quantize accordinglyIwan Kawrakow
2024-08-01iq3_k: BasicsIwan Kawrakow
2024-08-01iq5_k: BasicsIwan Kawrakow
2024-08-01iq2_k: BasicsIwan Kawrakow
2024-07-28IQ4_K: SOTA 4-bit quantization (#6)Kawrakow
2024-07-27Merge mainline llama.cpp (#3)Kawrakow
2024-07-24Add copyright noticesIwan Kawrakow
2024-06-26imatrix: be able to specify the name of the output tensorIwan Kawrakow
2024-06-24Bitnet: tiny bity faster 1.625 bpw variant on MetalIwan Kawrakow
2024-06-22bitnet: add 2 bpw quantizationIwan Kawrakow
2024-06-22bitnet: CUDA, scalar, AVX2Iwan Kawrakow
2024-06-21llama : allow pooled embeddings on any model (#7477)Douglas Hanley
2024-06-21swiftui : enable stream updating (#7754)Shuichi Tsutsumi
2024-06-20[SYCL] Fix windows build and inference (#8003)luoyu-intel
2024-06-20server : fix smart slot selection (#8020)sasha0552
2024-06-18Only use FIM middle token if it exists (#7648)Sigbjørn Skjæret
2024-06-17Add support for sqrt on CUDA (#7953)Calvin Laurenson
2024-06-15Add `cvector-generator` example (#7514)Xuan Son Nguyen
2024-06-14llama-bench : fix RPC indication (#7936)Radoslav Gerganov
2024-06-13move BLAS to a separate backend (#6210)slaren
2024-06-13`build`: rename main → llama-cli, server → llama-server, llava-cli → ll...Olivier Chafik
2024-06-12server : restore numeric prompts (#7883)Georgi Gerganov
2024-06-11llama-bench: more compact markdown tables (#7879)Johannes Gäßler
2024-06-11json: refine constraint for whitespace to avoid runaways yet allow pretty pri...Olivier Chafik
2024-06-11`json`: document schema conversion in GBNF readme, align manual grammar examp...Olivier Chafik
2024-06-10examples : remove --instruct remnants (#7846)Georgi Gerganov
2024-06-10server : improve "prompt" handling (#7847)Georgi Gerganov
2024-06-09imatrix : handle partial entries (#7833)Georgi Gerganov
2024-06-09server: do not remove whitespace at the start of a completion chunk (#7830)mgroeber9110
2024-06-09Revert "[SYCL] Update rpc-server.cpp to include SYCL backend (#7682)" (#7808)slaren
2024-06-08server : smart slot selection using Longest Common Prefix (#7728)sasha0552
2024-06-07gguf-split : change binary multi-byte units to decimal (#7803)Christian Zhou-Zheng
2024-06-07server: update cache_prompt documentation [no ci] (#7745)Johannes Gäßler
2024-06-07server : do not get prompt in infill mode (#7286)woodx
2024-06-07check for nans in imatrix and quantize (#7807)slaren
2024-06-06imatrix : migrate to gpt_params (#7771)Georgi Gerganov
2024-06-06grammars: x{min,max} repetition operator (#6640)Olivier Chafik
2024-06-05ggml : refactor rope norm/neox (#7634)Georgi Gerganov
2024-06-05readme : remove -ins (#7759)arch-btw
2024-06-04common : refactor cli arg parsing (#7675)Georgi Gerganov
2024-06-04ggml : remove OpenCL (#7735)Georgi Gerganov
2024-06-04llama : remove beam search (#7736)Georgi Gerganov
2024-06-04llama-bench : allow using a different printer for stderr with -oe (#7722)slaren
2024-06-02[SYCL] Update rpc-server.cpp to include SYCL backend (#7682)nickp27
2024-06-01server : new UI (#7633)Yazan Agha-Schrader
2024-06-02SimpleChat: Simple histogram/repeatMatching driven garbageTrimming, Settings ...HanishKVC
2024-05-31server : update js (#7670)Georgi Gerganov
2024-05-30Move convert.py to examples/convert-legacy-llama.py (#7430)Galunid
2024-05-29llama-bench : add support for the RPC backend (#7435)Radoslav Gerganov