diff options
author | Justine Tunney <jtunney@gmail.com> | 2023-12-29 06:38:38 -0800 |
---|---|---|
committer | GitHub <noreply@github.com> | 2023-12-29 16:38:38 +0200 |
commit | 4af4801566bc262a38fb77f51edf278ac323c2bd (patch) | |
tree | adefcd515c9cdafbf9bb7c6755c2b77b14ef4b9e /examples/server | |
parent | db49ff8ed7f0bb201176703441cc02911b08ef2a (diff) |
llava-cli : refactor to use sampling library (#4669)
This change makes it possible to use flags like `--grammar` when using
the `llava-cli` program. The rest is just code cleanup deleting a long
standing TODO comment.
This change also ensures that logging information is emitted to stderr
which helps the `llava-cli` command be more friendly to shell scripts.
See Mozilla-Ocho/llamafile@1cd334f
Diffstat (limited to 'examples/server')
0 files changed, 0 insertions, 0 deletions