diff options
| author | Daniel Bevenius <daniel.bevenius@gmail.com> | 2024-02-19 09:31:59 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-02-19 10:31:59 +0200 |
| commit | 70847553963c85e86051d06df848236829f5f951 (patch) | |
| tree | 6d85b7f00ab7aaaa86b0db84019644946e378ee8 | |
| parent | 4480542b2271ba1438f0daff8e5f3a74b1dc8609 (diff) | |
llava : avoid changing the original BakLLaVA model (#5577)
This is a follup of Commit fc0c8d286a533363a9a663510b62af85ffad58b3
("llava : update surgery script to not remove tensors") but this time
the change is to the BakLLaVA specific part of the surgery script.
I've been able to test this using SkunkworksAI/BakLLaVA-1 and it works
as expected using the instructions in README.md.
Signed-off-by: Daniel Bevenius <daniel.bevenius@gmail.com>
| -rw-r--r-- | examples/llava/llava-surgery.py | 4 |
1 files changed, 0 insertions, 4 deletions
diff --git a/examples/llava/llava-surgery.py b/examples/llava/llava-surgery.py index 8b7a62fb..4f2da3be 100644 --- a/examples/llava/llava-surgery.py +++ b/examples/llava/llava-surgery.py @@ -25,9 +25,6 @@ if len(clip_tensors) > 0: clip = {name.replace("vision_tower.vision_tower.", ""): checkpoint[name].float() for name in clip_tensors} torch.save(clip, f"{args.model}/llava.clip") - # remove these tensors - for name in clip_tensors: - del checkpoint[name] # added tokens should be removed to be able to convert Mistral models if os.path.exists(f"{args.model}/added_tokens.json"): @@ -35,7 +32,6 @@ if len(clip_tensors) > 0: f.write("{}\n") - torch.save(checkpoint, path) print("Done!") print(f"Now you can convert {args.model} to a regular LLaMA GGUF file.") |