diff options
author | Michaƫl de Vries <vriesdemichael@gmail.com> | 2024-02-15 14:14:37 +0100 |
---|---|---|
committer | GitHub <noreply@github.com> | 2024-02-15 14:14:37 +0100 |
commit | 73122473ffd73030146276dbb85da7c8021a3ee4 (patch) | |
tree | 51544fef2e4d934553a5569eab83e385622cfd46 /scripts | |
parent | 0d4177126b0556e202efb85bf3f768be81076400 (diff) |
fix(gguf-py): special tokens are no longer skipped when add_<token>_token is set to false (#5487)
* fix(gguf-py): special tokens are no longer skipped when add_<token>_token is set to false
* fix(gguf-py): added missing cls and mask token ids to the gguf metadata
Diffstat (limited to 'scripts')
0 files changed, 0 insertions, 0 deletions