| Age | Commit message (Collapse) | Author | |
|---|---|---|---|
| 2024-06-02 | [SYCL] Update rpc-server.cpp to include SYCL backend (#7682) | nickp27 | |
| * Update rpc-server.cpp to include SYCL backend Draft PR to address inclusion of SYCL backend for RPC server * Update rpc-server.cpp | |||
| 2024-05-17 | rpc : set SO_REUSEADDR for the server socket (#7320) | Radoslav Gerganov | |
| ref: #7293 | |||
| 2024-05-16 | rpc : get available mem for the CPU backend | Radoslav Gerganov | |
| This can be overridden with the -m command line option ref: #7293 | |||
| 2024-05-16 | rpc : add command line arg for specifying backend memory | Radoslav Gerganov | |
| ref: #7293 | |||
| 2024-05-14 | ggml : add RPC backend (#6829) | Radoslav Gerganov | |
| * ggml : add RPC backend The RPC backend proxies all operations to a remote server which runs a regular backend (CPU, CUDA, Metal, etc). * set TCP_NODELAY * add CI workflows * Address review comments * fix warning * implement llama_max_devices() for RPC * Address review comments * Address review comments * wrap sockfd into a struct * implement get_alignment and get_max_size * add get_device_memory * fix warning * win32 support * add README * readme : trim trailing whitespace * Address review comments * win32 fix * Address review comments * fix compile warnings on macos | |||
 |
index : ik_llama.cpp.git | |
| Unnamed repository; edit this file 'description' to name the repository. |
| summaryrefslogtreecommitdiff |