summaryrefslogtreecommitdiff
path: root/examples/batched.swift/Sources
AgeCommit message (Collapse)Author
2023-10-17tokenizer : special token handling (#3538)staviq
* Rewrite special token handling from #1931 * shorten param name, add st verification by type * use offsets instead of copy by substr * formatting, remove copying iterator on delete * llama : normalize code-style * swift fix * print pfx/sfx if verb, main: split pfx input sfx * dont add space when using special tokens * minor : comment + spacing --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-10-11examples : add batched.swift + improve CI for swift (#3562)Zane Shannon