diff options
| author | Pierrick Hymbert <pierrick.hymbert@gmail.com> | 2024-03-08 12:25:04 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-08 12:25:04 +0100 |
| commit | 76e868821a94072fbc87cb1fcca291694319eae8 (patch) | |
| tree | c25aeb945cd47b39875a24df0bc42abbb60196a6 /examples/server/tests/features/server.feature | |
| parent | e457fb3540e0aaec47cfde0abf784c213f9216ee (diff) | |
server: metrics: add llamacpp:prompt_seconds_total and llamacpp:tokens_predicted_seconds_total, reset bucket only on /metrics. Fix values cast to int. Add Process-Start-Time-Unix header. (#5937)
Closes #5850
Diffstat (limited to 'examples/server/tests/features/server.feature')
| -rw-r--r-- | examples/server/tests/features/server.feature | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/examples/server/tests/features/server.feature b/examples/server/tests/features/server.feature index f3b758c7..878ac136 100644 --- a/examples/server/tests/features/server.feature +++ b/examples/server/tests/features/server.feature @@ -29,6 +29,7 @@ Feature: llama.cpp server And a completion request with no api error Then <n_predicted> tokens are predicted matching <re_content> And prometheus metrics are exposed + And metric llamacpp:tokens_predicted is <n_predicted> Examples: Prompts | prompt | n_predict | re_content | n_predicted | |