summaryrefslogtreecommitdiff
path: root/examples/export-lora/README.md
diff options
context:
space:
mode:
Diffstat (limited to 'examples/export-lora/README.md')
-rw-r--r--examples/export-lora/README.md23
1 files changed, 15 insertions, 8 deletions
diff --git a/examples/export-lora/README.md b/examples/export-lora/README.md
index 1fb17fee..91c33c34 100644
--- a/examples/export-lora/README.md
+++ b/examples/export-lora/README.md
@@ -6,12 +6,11 @@ Apply LORA adapters to base model and export the resulting model.
usage: llama-export-lora [options]
options:
- -h, --help show this help message and exit
- -m FNAME, --model-base FNAME model path from which to load base model (default '')
- -o FNAME, --model-out FNAME path to save exported model (default '')
- -l FNAME, --lora FNAME apply LoRA adapter
- -s FNAME S, --lora-scaled FNAME S apply LoRA adapter with user defined scaling S
- -t N, --threads N number of threads to use during computation (default: 4)
+ -m, --model model path from which to load base model (default '')
+ --lora FNAME path to LoRA adapter (can be repeated to use multiple adapters)
+ --lora-scaled FNAME S path to LoRA adapter with user defined scaling S (can be repeated to use multiple adapters)
+ -t, --threads N number of threads to use during computation (default: 4)
+ -o, --output FNAME output file (default: 'ggml-lora-merged-f16.gguf')
```
For example:
@@ -20,7 +19,15 @@ For example:
./bin/llama-export-lora \
-m open-llama-3b-v2-q8_0.gguf \
-o open-llama-3b-v2-q8_0-english2tokipona-chat.gguf \
- -l lora-open-llama-3b-v2-q8_0-english2tokipona-chat-LATEST.bin
+ --lora lora-open-llama-3b-v2-q8_0-english2tokipona-chat-LATEST.gguf
```
-Multiple LORA adapters can be applied by passing multiple `-l FN` or `-s FN S` command line parameters.
+Multiple LORA adapters can be applied by passing multiple `--lora FNAME` or `--lora-scaled FNAME S` command line parameters:
+
+```bash
+./bin/llama-export-lora \
+ -m your_base_model.gguf \
+ -o your_merged_model.gguf \
+ --lora-scaled lora_task_A.gguf 0.5 \
+ --lora-scaled lora_task_B.gguf 0.5
+```