diff options
| author | DAN™ <dranger003@gmail.com> | 2024-05-08 06:43:23 -0400 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-05-08 13:43:23 +0300 |
| commit | 4cd621c26de2095cd7c4464bdec5fe2e696ef3f3 (patch) | |
| tree | 9949775dc9a6ae5c5d1d0370137b1f2bfaf86f62 /ggml-cuda/clamp.cu | |
| parent | 7e0b6a7b3ba94ff624dc27c1e0e735fded8819b8 (diff) | |
convert : add BPE pre-tokenization for DBRX (#7132)
* Add BPE pre-tokenization for DBRX.
* Add vocab GGUFs.
* Remove test.
* Remove GGUFs.
Diffstat (limited to 'ggml-cuda/clamp.cu')
0 files changed, 0 insertions, 0 deletions