summaryrefslogtreecommitdiff
path: root/gguf-py/gguf/vocab.py
AgeCommit message (Expand)Author
2023-12-21py : open merges file as 'utf-8' (#4566)howlger
2023-12-17gguf-py : fail fast on nonsensical special token IDs (#4489)Jared Van Bortel
2023-11-19gguf-py : export chat templates (#4125)slaren
2023-11-16Respect tokenizer.ggml.add_bos_token value when tokenizing (#4040)Kerfuffle
2023-11-11gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)Kerfuffle