summaryrefslogtreecommitdiff
path: root/convert-hf-to-gguf-update.py
AgeCommit message (Expand)Author
2024-05-05command-r : add BPE pre-tokenization (#7063)DAN™
2024-05-05py : logging and flake8 suppression refactoring (#7081)Brian
2024-05-04tests : add test-tokenizer-0.sh + fix some tokenizers (#7036)Georgi Gerganov
2024-05-03convert.py : add python logging instead of print() (#6511)Brian
2024-04-30convert : use utf8 encoding (#7000)Georgi Gerganov
2024-04-29llama : fix BPE pre-tokenization (#6920)Georgi Gerganov