diff options
| author | Branden Butler <bwtbutler@hotmail.com> | 2023-11-20 03:50:04 -0600 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-11-20 11:50:04 +0200 |
| commit | 40a34fe8d034bd484efd79ccbb95059ca6308dcb (patch) | |
| tree | d764cf818b68c98228a2db8bde539241dce78f6c /convert-hf-to-gguf.py | |
| parent | dae06c06e5c6232ae2be4d567dd5101e1e96c814 (diff) | |
speculative : fix prompt tokenization in speculative example (#4025)
* Support special tokens and not adding BOS to prompt in speculative
* Adapt to new should_add_bos function
* Ensure tgt and dft have same add_bos setting
Diffstat (limited to 'convert-hf-to-gguf.py')
0 files changed, 0 insertions, 0 deletions