diff options
| author | Pierrick Hymbert <pierrick.hymbert@gmail.com> | 2024-04-13 11:33:52 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-04-13 11:33:52 +0200 |
| commit | 4bd0f93e4ab4fe6682e7d0241c1bdec1397e954a (patch) | |
| tree | da912ccbf957473fb5aa6868c9cd73f0fcc42e63 /scripts | |
| parent | ab9a3240a9da941fdef5cd4a25f2b97c2f5a67aa (diff) | |
model: support arch `DbrxForCausalLM` (#6515)
* model: dbrx convert to gguf
#6344
* llama: support dbrx
#6344
* doc: dbrx: add the model as supported
* scripts: get-wikitext-2 add unzip
* llama: increase maximum experts allowed
* llama: factorize moe graph implementation between grok, mixtral and dbrx
---------
Co-authored-by: Megha Agarwal <16129366+megha95@users.noreply.github.com>
Diffstat (limited to 'scripts')
| -rwxr-xr-x | scripts/get-wikitext-2.sh | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/scripts/get-wikitext-2.sh b/scripts/get-wikitext-2.sh index 7ca760fa..b01476a4 100755 --- a/scripts/get-wikitext-2.sh +++ b/scripts/get-wikitext-2.sh @@ -1,10 +1,11 @@ #!/bin/bash wget https://huggingface.co/datasets/ggml-org/ci/resolve/main/wikitext-2-raw-v1.zip +unzip wikitext-2-raw-v1.zip echo "Usage:" echo "" -echo " ./perplexity -m model.gguf -f wiki.test.raw [other params]" +echo " ./perplexity -m model.gguf -f wikitext-2-raw/wiki.test.raw [other params]" echo "" exit 0 |