summaryrefslogtreecommitdiff
path: root/examples
diff options
context:
space:
mode:
authorIan Bull <irbull@gmail.com>2024-02-01 23:20:13 -0800
committerGitHub <noreply@github.com>2024-02-02 09:20:13 +0200
commite1e721094d8169636d55f68efe37f222cd3f0677 (patch)
tree9ba25970ab3932a892cc706b9d5c888749d90a7e /examples
parent128dcbd3c9c4b12f42b560a4430427d7b2828628 (diff)
llama : fix memory leak in llama_batch_free (#5252)
The llama_batch_init allocates memory for a fixed number of tokens. However, the llama_batch_free only frees memory for the number of tokens that were added to the batch. This change-set uses a null terminated array for the batch seq_id, and frees all the elements until the nullptr is reached. This change-set also changes the name of the first parameter from `n_tokens` to `n_tokens_alloc` to more clearly indicate that this value is the number of tokens allocated to the batch, not the number of tokens in the batch.
Diffstat (limited to 'examples')
0 files changed, 0 insertions, 0 deletions