summaryrefslogtreecommitdiff
path: root/gguf-py
diff options
context:
space:
mode:
authorOlivier Chafik <ochafik@users.noreply.github.com>2024-04-12 19:43:38 +0100
committerGitHub <noreply@github.com>2024-04-12 19:43:38 +0100
commitab9a3240a9da941fdef5cd4a25f2b97c2f5a67aa (patch)
treeaa2efe58bc95a650827db07c83eb8bc0e026162c /gguf-py
parentfbbc030ba93561fac842af994c5c6c4c1147f13b (diff)
JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)
* json: rename python schema converter to make import easier * server: skip null json_schema / grammar fields * json: deps management for primitive rules (+ allow null values) * json: optimize repetitions for minItems/maxItems and regexps: `a{,3}` goes from `"a"? "a"? "a"?` (explosive combos) to `(a (a (a)?)?)?` * grammars: add troubleshooting section to readme * json: cap length of numbers to 15 digits before/after decimal point (avoids infinite gen, e.g. "one third" -> `0.333333333333...`) * json: unify all repetition code (w/ or w/o sep) * json: support string minLength/maxLength * server+json: update server/README w/ result_format * nits * json: fix type error w/ python 3.8 * json: fix server/README (json_schema in /completion vs. result_format in /v1/chat/completions) * json: simplify DOT `{"type": "string", "pattern": "^.$"}` * json: remove recursion in opt_repetitions (avoids Python stack overflow) * json: rm dead code * json: rm useless assert & ggml.h import
Diffstat (limited to 'gguf-py')
0 files changed, 0 insertions, 0 deletions