diff options
author | Marcus Dunn <51931484+MarcusDunn@users.noreply.github.com> | 2023-12-05 10:55:12 -1000 |
---|---|---|
committer | GitHub <noreply@github.com> | 2023-12-05 22:55:12 +0200 |
commit | 5f6e0c0dff1e7a89331e6b25eca9a9fd71324069 (patch) | |
tree | bb701e1396519dea10f58d13164750a5624d2f02 /common/sampling.cpp | |
parent | 5aa365d88fdb8fdd430ef3fc141c7a5fd37c3502 (diff) |
grammar : pre-computed pieces + reserve mem + less string copies (#4330)
* reserve space for codepoints
* improvement for the appended 0
* used precomputed token text for grammar sample
* reserve canidates_decoded
* reserve canidates_grammar
* remove candidates_decoded
* Revert "remove candidates_decoded"
This reverts commit 3773328080e6a139ee83198329a13cf4ff61d707.
* changed decode_utf8 to take src by ref
Diffstat (limited to 'common/sampling.cpp')
0 files changed, 0 insertions, 0 deletions