index
:
ik_llama.cpp.git
main
Unnamed repository; edit this file 'description' to name the repository.
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
convert-hf-to-gguf-update.py
Age
Commit message (
Expand
)
Author
2024-06-14
convert : add Poro-34B-chat tokenizer support (#7713)
Elaine
2024-06-06
llama : add jina v2 base code (#7596)
Joan Fontanals
2024-06-06
Fix encoding in python scripts (#7733)
Galunid
2024-05-26
llama : add Smaug 70B support (#7402)
Bartowski
2024-05-21
tests : test-tokenizer-0.sh print more info (#7402)
Georgi Gerganov
2024-05-19
Add StableLM2 pre-tokenizer (#7349)
Anas Ahouzi
2024-05-17
py : convert-hf-to-gguf-update improvements (#7340)
Aarni Koskela
2024-05-13
llama : rename jina tokenizers to v2 (#7249)
Joan Fontanals
2024-05-11
convert : skip unaccessible HF repos (#7210)
CrispStrobe
2024-05-11
llama : add Jina Embeddings architecture (#6826)
Joan Fontanals
2024-05-10
convert : print "ignore_merges" field
Georgi Gerganov
2024-05-09
llama3 custom regex split (#6965)
jaime-m-p
2024-05-09
Add warning if token is invalid (#7173)
Galunid
2024-05-08
llama : add BPE pre-tokenization for Qwen2 (#7114)
Ren Xuancheng
2024-05-08
convert : add BPE pre-tokenization for DBRX (#7132)
DAN™
2024-05-08
py : also print the normalizers
Georgi Gerganov
2024-05-07
Fix OLMo HF to GGUF conversion (#6910)
nopperl
2024-05-05
command-r : add BPE pre-tokenization (#7063)
DAN™
2024-05-05
py : logging and flake8 suppression refactoring (#7081)
Brian
2024-05-04
tests : add test-tokenizer-0.sh + fix some tokenizers (#7036)
Georgi Gerganov
2024-05-03
convert.py : add python logging instead of print() (#6511)
Brian
2024-04-30
convert : use utf8 encoding (#7000)
Georgi Gerganov
2024-04-29
llama : fix BPE pre-tokenization (#6920)
Georgi Gerganov