diff options
| author | Behnam M <58621210+ibehnam@users.noreply.github.com> | 2024-01-11 12:41:39 -0500 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-11 19:41:39 +0200 |
| commit | eab67950068e4b125007d027232c47d2a5831cd0 (patch) | |
| tree | c4ba752bcef0d5232c13a7879a81a26527231213 /examples/server/server.cpp | |
| parent | d8d90aa343c22fe01429d3540e47ded87e9dcb9d (diff) | |
server : add `LOG_INFO` when model is successfully loaded (#4881)
* added /health endpoint to the server
* added comments on the additional /health endpoint
* Better handling of server state
When the model is being loaded, the server state is `LOADING_MODEL`. If model-loading fails, the server state becomes `ERROR`, otherwise it becomes `READY`. The `/health` endpoint provides more granular messages now according to the server_state value.
* initialized server_state
* fixed a typo
* starting http server before initializing the model
* Update server.cpp
* Update server.cpp
* fixes
* fixes
* fixes
* made ServerState atomic and turned two-line spaces into one-line
* updated `server` readme to document the `/health` endpoint too
* used LOG_INFO after successful model loading
Diffstat (limited to 'examples/server/server.cpp')
| -rw-r--r-- | examples/server/server.cpp | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/examples/server/server.cpp b/examples/server/server.cpp index 860e4e9a..51a4b689 100644 --- a/examples/server/server.cpp +++ b/examples/server/server.cpp @@ -2906,6 +2906,7 @@ int main(int argc, char **argv) } else { llama.initialize(); state.store(SERVER_STATE_READY); + LOG_INFO("model loaded", {}); } // Middleware for API key validation |