diff options
Diffstat (limited to 'examples/rpc/README.md')
| -rw-r--r-- | examples/rpc/README.md | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/examples/rpc/README.md b/examples/rpc/README.md index e1da801f..adedc890 100644 --- a/examples/rpc/README.md +++ b/examples/rpc/README.md @@ -1,5 +1,9 @@ ## Overview +> [!IMPORTANT] +> This example and the RPC backend are currently in a proof-of-concept development stage. As such, the functionality is fragile and +> insecure. **Never run the RPC server on an open network or in a sensitive environment!** + The `rpc-server` allows running `ggml` backend on a remote host. The RPC backend communicates with one or several instances of `rpc-server` and offloads computations to them. This can be used for distributed LLM inference with `llama.cpp` in the following way: |