diff options
| author | bryanSwk <93190252+bryanSwk@users.noreply.github.com> | 2024-04-04 02:05:10 +0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-04-03 21:05:10 +0300 |
| commit | bb43cf7e9d86d69ffd9c7f008f75db890a35b45a (patch) | |
| tree | 4abfed45ae4e8c2dd59c0a49df4c0f0cf801515e /README.md | |
| parent | 9f62c0173d964972849251c8ad12fc356f5b7896 (diff) | |
llama : add SEA-LION support (#6448)
* initial commit for sealion support
* add sealion support
* minor fix
* q/k ln and pos_embd only if required
* Apply suggestions from code review
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* minor : clear whitespaces
---------
Co-authored-by: bryan <bryansiow@aisingapore.org>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 1 |
1 files changed, 1 insertions, 0 deletions
@@ -118,6 +118,7 @@ Typically finetunes of the base models below are supported as well. - [x] [Mamba](https://github.com/state-spaces/mamba) - [x] [Xverse](https://huggingface.co/models?search=xverse) - [x] [Command-R](https://huggingface.co/CohereForAI/c4ai-command-r-v01) +- [x] [SEA-LION](https://huggingface.co/models?search=sea-lion) **Multimodal models:** |