diff options
| author | goerch <jhr.walter@t-online.de> | 2023-10-10 18:59:52 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-10-10 18:59:52 +0200 |
| commit | 233fc1c69f6f415f35363e18a755f9610e89161b (patch) | |
| tree | d949e9cdaa21419b2a03e7eeb81852cd7a5e6240 /examples/batched.swift | |
| parent | c5b49360d0d9e49f32e05a9116e90bd0b39a282d (diff) | |
Minor improvements in GPT2 tokenizer (#3567)
* Fixing minor bugs in bpe_gpt2_preprocess
* Don't add bos token in test
Diffstat (limited to 'examples/batched.swift')
0 files changed, 0 insertions, 0 deletions