summaryrefslogtreecommitdiff
path: root/examples/passkey/README.md
blob: 2b8e910f9658d66a8623f8146e1cd7f772e539ea (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
# llama.cpp/example/passkey

A passkey retrieval task is an evaluation method used to measure a language
models ability to recall information from long contexts.

See the following PRs for more info:

- https://github.com/ggerganov/llama.cpp/pull/3856
- https://github.com/ggerganov/llama.cpp/pull/4810

### Usage

```bash
make -j && ./llama-passkey -m ./models/llama-7b-v2/ggml-model-f16.gguf --junk 250
```