diff options
author | hxer7963 <hxer7963@gmail.com> | 2024-03-29 21:37:03 +0800 |
---|---|---|
committer | GitHub <noreply@github.com> | 2024-03-29 14:37:03 +0100 |
commit | 069574775cea67d8a977904e4d534aff47a671f4 (patch) | |
tree | 0a599af29292d6ec5826533fa4bfc60e0e33f573 /scripts/sync-ggml.sh | |
parent | cfde806eb95de06d84162bdee593dad33a1d2693 (diff) |
[Model] Add support for xverse (#6301)
* Support xverse model convert to gguf format.
* 1. Convert xverse models to gguf;
2. Add LLM_ARCH_XVERSE inference in llama.cpp;
3. Add xverse item in Supported models in README.md;
* * gguf-py: remove redundant logs
* llama: remove the init_mapping_prefetch custom parameter
* llama.cpp: Include the changes from #6122 to exclude the unused outputs of the last layers.
* - Fix format issues
- Remove duplicate set kqv_out to llm_build_kv
* Update llama.cpp
---------
Co-authored-by: willhe <willhe@xverse.cn>
Co-authored-by: willhe <hexin@xverse.cn>
Diffstat (limited to 'scripts/sync-ggml.sh')
0 files changed, 0 insertions, 0 deletions