diff options
| author | Douglas Hanley <thesecretaryofwar@gmail.com> | 2024-02-11 10:21:38 -0600 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-02-11 11:21:38 -0500 |
| commit | 2891c8aa9af17f4ff636ff3868bc34ff72b56e25 (patch) | |
| tree | 1a037e8ad635aa54ddf8ab8cb39c04bb4f8cf141 /examples/embedding/README.md | |
| parent | 97a336507ed9b971d72262bec7e2b8b7016a054a (diff) | |
Add support for BERT embedding models (#5423)
* BERT model graph construction (build_bert)
* WordPiece tokenizer (llm_tokenize_wpm)
* Add flag for non-causal attention models
* Allow for models that only output embeddings
* Support conversion of BERT models to GGUF
* Based on prior work by @xyzhang626 and @skeskinen
---------
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/embedding/README.md')
0 files changed, 0 insertions, 0 deletions