diff options
| author | zhangkaihuo <zhangkaihuo@gmail.com> | 2024-06-03 15:49:30 +0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-06-03 10:49:30 +0300 |
| commit | 6f28a333c1e3fdfdc7b4f9d0367f2b41a9b7e9d4 (patch) | |
| tree | 44e54d11d4fca4edda050f8206157065a06ac60d /gguf-py | |
| parent | 549279d8049d78620a2b081e26edb654f83c3bbd (diff) | |
llama : MiniCPM support tied embeddings (#7664)
* support lm_head
* remove the code block
---------
Co-authored-by: zhangkaihuo <zhangkaihuo@modelbest.cn>
Diffstat (limited to 'gguf-py')
| -rw-r--r-- | gguf-py/gguf/constants.py | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/gguf-py/gguf/constants.py b/gguf-py/gguf/constants.py index 55ec2cb5..a3c024c8 100644 --- a/gguf-py/gguf/constants.py +++ b/gguf-py/gguf/constants.py @@ -645,6 +645,7 @@ MODEL_TENSORS: dict[MODEL_ARCH, list[MODEL_TENSOR]] = { ], MODEL_ARCH.MINICPM: [ MODEL_TENSOR.TOKEN_EMBD, + MODEL_TENSOR.OUTPUT, MODEL_TENSOR.OUTPUT_NORM, MODEL_TENSOR.ROPE_FREQS, MODEL_TENSOR.ATTN_NORM, |