diff options
author | Anas Ahouzi <112881240+aahouzi@users.noreply.github.com> | 2024-02-25 10:54:04 +0100 |
---|---|---|
committer | GitHub <noreply@github.com> | 2024-02-25 11:54:04 +0200 |
commit | 69917dfa55674c608360638bb4d6a12a315e2810 (patch) | |
tree | 76bf37a8e692bd3109787ee045350abba93b48a8 /examples | |
parent | 9e359a4f47c1b2dceb99e29706c9f7403d32ab5e (diff) |
py : fix StableLM conversion after config.json changes (#5703)
* Fix issues during StableLM models conversion
* Fix hard coded layer_norm_eps
* Support layer_norm_eps for LlavaStableLM
Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>
* Add missing parenthesis
Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>
* Support rotary_factor for LlavaStableLM
Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>
* fix typo
* Add StableLMEpochForCausalLM for safety
Co-authored-by: compilade <113953597+compilade@users.noreply.github.com>
* Add StableLMEpochForCausalLM for safety 2
Co-authored-by: compilade <113953597+compilade@users.noreply.github.com>
---------
Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
Co-authored-by: compilade <113953597+compilade@users.noreply.github.com>
Diffstat (limited to 'examples')
0 files changed, 0 insertions, 0 deletions