diff options
| author | wonjun Jang <strutive07@gmail.com> | 2023-12-27 17:37:25 +0900 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-12-27 17:37:25 +0900 |
| commit | f56d6077d0c37e6606ac0a4fa3169de70593acfe (patch) | |
| tree | 1c7eca9489b2bb8e2723f3d005c18770d58fa9a8 /gguf-py/tests/test_gguf.py | |
| parent | dc68f0054cd279cddddb0cae0c9ef4f9cbaa512a (diff) | |
Add byte token type when tokenizer.model is not exists (#4641)
* Add byte token type to hf format
* remove unused variable
Diffstat (limited to 'gguf-py/tests/test_gguf.py')
0 files changed, 0 insertions, 0 deletions