summaryrefslogtreecommitdiff
path: root/examples/server
diff options
context:
space:
mode:
authorOlivier Chafik <ochafik@users.noreply.github.com>2024-04-11 19:47:34 +0100
committerGitHub <noreply@github.com>2024-04-11 19:47:34 +0100
commitcbaadc92942c50aab599a9e4c163afc1f44f7c26 (patch)
tree0a4b962430740a81a6b1789f1edd9ee50074dde3 /examples/server
parent1bbdaf6ecda6f0a360dfb307b256fcb6838c560b (diff)
grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609)
* grammars: reserve rejects & next candidates * grammars: reuse new_stacks * grammars: fix missing sig change in llama.h * grammars: fix test (api changed) * grammars: update gbnf-validator.cpp * grammars: simpler syntax (no swap)
Diffstat (limited to 'examples/server')
0 files changed, 0 insertions, 0 deletions