Age | Commit message (Expand) | Author |
---|---|---|
2023-10-23 | Update special token handling in conversion scripts for gpt2 derived tokenize... | Galunid |
2023-10-22 | llama : validate special token ids are in range when loading GGUF model (#3635) | Kerfuffle |
2023-10-03 | Work on the BPE tokenizer (#3252) | goerch |
2023-10-02 | convert : fix vocab size when not defined in hparams (#3421) | cebtenzzre |
2023-09-28 | gguf : make token scores and types optional (#3347) | Cebtenzzre |
2023-09-15 | llama : add support for StarCoder model architectures (#3187) | Meng Zhang |