diff options
| author | Pierrick Hymbert <pierrick.hymbert@gmail.com> | 2024-02-25 21:46:29 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-02-25 21:46:29 +0100 |
| commit | 8b350356b28f782deab63d8b0e9ae103ceb25fcd (patch) | |
| tree | fe8ae94da85a19ebdfc87ed88f53f8a224d56313 /README.md | |
| parent | bf08e00643fd529f748f0a858fd79f3061e3fa18 (diff) | |
server: docs - refresh and tease a little bit more the http server (#5718)
* server: docs - refresh and tease a little bit more the http server
* Rephrase README.md server doc
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* Update examples/server/README.md
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* Update examples/server/README.md
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* Update README.md
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 3 |
1 files changed, 3 insertions, 0 deletions
@@ -114,6 +114,9 @@ Typically finetunes of the base models below are supported as well. - [x] [MobileVLM 1.7B/3B models](https://huggingface.co/models?search=mobileVLM) - [x] [Yi-VL](https://huggingface.co/models?search=Yi-VL) +**HTTP server** + +[llama.cpp web server](./examples/server) is a lightweight [OpenAI API](https://github.com/openai/openai-openapi) compatible HTTP server that can be used to serve local models and easily connect them to existing clients. **Bindings:** |