Age | Commit message (Collapse) | Author | |
---|---|---|---|
2023-10-17 | tokenizer : special token handling (#3538) | staviq | |
* Rewrite special token handling from #1931 * shorten param name, add st verification by type * use offsets instead of copy by substr * formatting, remove copying iterator on delete * llama : normalize code-style * swift fix * print pfx/sfx if verb, main: split pfx input sfx * dont add space when using special tokens * minor : comment + spacing --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> | |||
2023-10-11 | examples : add batched.swift + improve CI for swift (#3562) | Zane Shannon | |