diff options
| author | Pedro Cuenca <pedro@huggingface.co> | 2024-03-29 08:15:00 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-29 09:15:00 +0200 |
| commit | b75c38166cf0c66793a32d5c3d6cb69929dd083d (patch) | |
| tree | cd13af30af2206189ee76402e95935e345a4e83e /examples/perplexity | |
| parent | bfe7dafc9cf96b9a09ead347fed9a547930fc631 (diff) | |
convert : allow conversion of Mistral HF models (#6144)
* Allow conversion of Mistral HF models
* Homogenize Llama, Mistral, Mixtral under the same entry.
* Fix tokenizer, permute tensors
* Use sentencepiece tokenizer, or fall back to hfft.
* convert-hf : small fix for mypy
* convert-hf : fix duplicated block_count
* convert-hf : add vocab size to metadata
---------
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
Diffstat (limited to 'examples/perplexity')
0 files changed, 0 insertions, 0 deletions