diff options
author | Phil H <5756783+phiharri@users.noreply.github.com> | 2024-01-02 15:48:49 +0000 |
---|---|---|
committer | GitHub <noreply@github.com> | 2024-01-02 17:48:49 +0200 |
commit | 0ef3ca2ac62016c0c545de1c89dc2e3e130f4a99 (patch) | |
tree | 0139d147de2930114deecb04d4ee1eca0a88cc7a /examples/server/public | |
parent | 540938f8904707dd74cb3be18495f853b312e72f (diff) |
server : add token counts to html footer (#4738)
* server: add token counts to stats
* server: generate hpp
---------
Co-authored-by: phiharri <ph@got-root.co.uk>
Diffstat (limited to 'examples/server/public')
-rw-r--r-- | examples/server/public/index.html | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/examples/server/public/index.html b/examples/server/public/index.html index 07d779d2..b059c75f 100644 --- a/examples/server/public/index.html +++ b/examples/server/public/index.html @@ -427,7 +427,7 @@ } if (data.timings) { - llamaStats.value = data.timings; + llamaStats.value = data; } } @@ -880,7 +880,7 @@ } return html` <span> - ${llamaStats.value.predicted_per_token_ms.toFixed()}ms per token, ${llamaStats.value.predicted_per_second.toFixed(2)} tokens per second + ${llamaStats.value.tokens_predicted} predicted, ${llamaStats.value.tokens_cached} cached, ${llamaStats.value.timings.predicted_per_token_ms.toFixed()}ms per token, ${llamaStats.value.timings.predicted_per_second.toFixed(2)} tokens per second </span> ` } |