diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2024-02-06 07:47:22 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-02-06 07:47:22 +0200 |
| commit | 906cff55c2848fda091d888a1585915ec0c9ea9e (patch) | |
| tree | a1229b3104020dac71711b6128ee9df94b16f7e8 /gguf-py/scripts/gguf-set-metadata.py | |
| parent | 098f6d737b65134cf220d12b9b706e8cfc5e4610 (diff) | |
py : handle byte tokens in `get_token_type` (#5341)
* py : handle byte tokens in `get_token_type`
* py : fix empty bytes arg
Diffstat (limited to 'gguf-py/scripts/gguf-set-metadata.py')
0 files changed, 0 insertions, 0 deletions