summaryrefslogtreecommitdiff
path: root/ci/README.md
diff options
context:
space:
mode:
authorGeorgi Gerganov <ggerganov@gmail.com>2023-07-22 11:48:22 +0300
committerGitHub <noreply@github.com>2023-07-22 11:48:22 +0300
commit5d500e8ccf5eee3de3ae66685cc3be75e43e08b9 (patch)
treeee9a26abffbfa688b33d98246bc3492fdbe1bb98 /ci/README.md
parent7d5f18468ceabd7a38f414f9f21b26b0c137f994 (diff)
ci : add 7B CUDA tests (#2319)
* ci : add 7B CUDA tests ggml-ci * ci : add Q2_K to the tests * ci : bump CUDA ppl chunks ggml-ci * ci : increase CUDA TG len + add --ignore-eos * ci : reduce CUDA ppl cunks down to 4 to save time
Diffstat (limited to 'ci/README.md')
-rw-r--r--ci/README.md5
1 files changed, 5 insertions, 0 deletions
diff --git a/ci/README.md b/ci/README.md
index 6c74c813..65cfe63e 100644
--- a/ci/README.md
+++ b/ci/README.md
@@ -16,5 +16,10 @@ It is a good practice, before publishing changes to execute the full CI locally
```bash
mkdir tmp
+
+# CPU-only build
bash ./ci/run.sh ./tmp/results ./tmp/mnt
+
+# with CUDA support
+GG_BUILD_CUDA=1 bash ./ci/run.sh ./tmp/results ./tmp/mnt
```