summaryrefslogtreecommitdiff
path: root/llama.cpp
AgeCommit message (Expand)Author
2024-05-31llama : cache llama_token_to_piece (#7587)Georgi Gerganov
2024-05-29ggml : fix YARN + add tests + add asserts (#7617)Georgi Gerganov
2024-05-28Tokenizer WPM fixes (#7500)jaime-m-p
2024-05-28llama : support small Granite models (#7481)Giuseppe Scrivano
2024-05-28Add support for DeepseekV2ForCausalLM (#7519)fairydreaming
2024-05-28llama : handle unknown utf8 bytes (#7588)Georgi Gerganov
2024-05-26llama : add Smaug 70B support (#7402)Bartowski
2024-05-25main : don't print special tokens with --grammar (#6923)Justine Tunney
2024-05-25ggml: aarch64: SVE kernels for q8_0_q8_0, q4_0_q8_0 vector dot (#7433)Masaya, Kato
2024-05-24Add support for ArcticForCausalLM (#7020)fairydreaming
2024-05-23Fix phi3 chat template confusion with zephyr (#7449)Tristan Druyen
2024-05-23llama : add getters for n_threads/n_threads_batch (#7464)Daniel Bevenius
2024-05-23ci : use Pythia models instead of OpenLlama (#7470)Georgi Gerganov
2024-05-23Add missing inference support for GPTNeoXForCausalLM (Pythia and GPT-NeoX bas...fairydreaming
2024-05-23llama : rename n_ctx -> cache.size, less confusing (#0)Georgi Gerganov
2024-05-23ggml : drop support for QK_K=64 (#7473)Georgi Gerganov
2024-05-22phi3 : duplicate rope factors in each layer (#7447)slaren
2024-05-22llama : add missing model type names (#7445)Justine Tunney
2024-05-21llama : add phi3 128K model support (#7225)liuwei-git
2024-05-21Tokenizer SPM fixes for phi-3 and llama-spm (bugfix) (#7425)jaime-m-p
2024-05-20Tokenizer SPM fixes for phi-3 and llama-spm (#7375)jaime-m-p
2024-05-21llama : remove Persimmon (#7408)Georgi Gerganov
2024-05-20ggml-opencl, llama: using reserve() if count already known (#7272)Herman Semenov
2024-05-20Add provisions for windows support for BF16 code including CMake provision fo...Srihari-mcw
2024-05-20llama : remove MPI backend (#7395)slaren
2024-05-19Add StableLM2 pre-tokenizer (#7349)Anas Ahouzi
2024-05-19Capture CUDA logging output (#7298)fraxy-v
2024-05-18llama : add support for larger Granite Code Models (20B, 34B) (#7324)Steffen Röcker
2024-05-18Unicode codepoint flags for custom regexs (#7245)jaime-m-p
2024-05-17llama : use n_embd_head_v when reshaping kqv (#7327)fairydreaming
2024-05-17tokenization: add warning for double BOS (#7332)Johannes Gäßler
2024-05-17ggml-quants, llama : removed excess checks (#7274)Herman Semenov
2024-05-16grammar, json, llama: replace push on emplace if it possible (#7273)Herman Semenov
2024-05-14ggml : add RPC backend (#6829)Radoslav Gerganov
2024-05-14llama : disable pipeline parallelism with nkvo (#7265)slaren
2024-05-14Add left recursion check: quit early instead of going into an infinite loop (...Haggai Nuchi
2024-05-13llama : less KV padding when FA is off (#7257)Georgi Gerganov
2024-05-13llama : rename jina tokenizers to v2 (#7249)Joan Fontanals
2024-05-11llama : lookup word in vocab before doing BPE merges (#7193)Haoxiang Fei
2024-05-11llama : add Jina Embeddings architecture (#6826)Joan Fontanals
2024-05-11ggml : full ALiBi support (#7192)Georgi Gerganov
2024-05-10llama : use n_vocab to differentiate between mistral 7B and llama3 8B (#7200)slaren
2024-05-09llama3 custom regex split (#6965)jaime-m-p
2024-05-09CUDA: generalize FP16 fattn vec kernel (#7061)Johannes Gäßler
2024-05-09llama : update llama_timings.n_p_eval setting (#7160)Daniel Bevenius
2024-05-08llama : add BPE pre-tokenization for Qwen2 (#7114)Ren Xuancheng
2024-05-08convert : add BPE pre-tokenization for DBRX (#7132)DAN™
2024-05-08ggml : introduce bfloat16 support (#6412)Justine Tunney
2024-05-07Fix OLMo HF to GGUF conversion (#6910)nopperl
2024-05-05command-r : add BPE pre-tokenization (#7063)DAN™