Age | Commit message (Collapse) | Author | |
---|---|---|---|
2024-03-26 | wpm : portable unicode tolower (#6305) | Jared Van Bortel | |
Also use C locale for ispunct/isspace, and split unicode-data.cpp from unicode.cpp. | |||
2024-03-11 | llama : refactor unicode stuff (#5992) | Georgi Gerganov | |
* llama : refactor unicode stuff ggml-ci * unicode : names * make : fix c++ compiler * unicode : names * unicode : straighten tables * zig : fix build * unicode : put nfd normalization behind API ggml-ci * swift : fix build * unicode : add BOM * unicode : add <cstdint> ggml-ci * unicode : pass as cpts as const ref |