diff options
| author | slaren <slarengh@gmail.com> | 2024-04-18 15:18:48 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-04-18 15:18:48 +0200 |
| commit | 0d56246f4b9764158525d894b96606f6163c53a8 (patch) | |
| tree | 43e57dfbbde67b701020fc3e2ac885e846925d26 /scripts/compare-commits.sh | |
| parent | 03c0946d73c63ea73e1d85015b7088298443d438 (diff) | |
ggml : group all experts in a single ggml_mul_mat_id (#6505)
* ggml : group all experts in a single ggml_mul_mat_id
cuda : improve mmid row copy
* cuda : fix bin bcast with non-cont src0
* test-backend-ops : only run all mul mat tests for base types
* llama : disable moe offloading with SYCL
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'scripts/compare-commits.sh')
| -rwxr-xr-x | scripts/compare-commits.sh | 14 |
1 files changed, 1 insertions, 13 deletions
diff --git a/scripts/compare-commits.sh b/scripts/compare-commits.sh index d1272506..fd0ee88b 100755 --- a/scripts/compare-commits.sh +++ b/scripts/compare-commits.sh @@ -12,19 +12,7 @@ bench_args="${@:3}" rm -f llama-bench.sqlite -backend="cpu" - -if [[ "$OSTYPE" == "darwin"* ]]; then - backend="metal" -elif command -v nvcc &> /dev/null; then - backend="cuda" -fi - -make_opts="" - -if [[ "$backend" == "cuda" ]]; then - make_opts="LLAMA_CUDA=1" -fi +# to test a backend, call the script with the corresponding environment variable (e.g. LLAMA_CUDA=1 ./scripts/compare-commits.sh ...) git checkout $1 make clean && make -j32 $make_opts llama-bench |