diff options
| author | shibe2 <shibe@tuta.io> | 2023-10-02 23:26:15 +0400 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-10-02 21:26:15 +0200 |
| commit | 665018c749101e81c816675198e731e47d6b1dbe (patch) | |
| tree | 4486f9b1484367d04d2609b57453af30cf0c8453 /examples/server/api_like_OAI.py | |
| parent | 29a404a951fb0b3f9c3b6ab8c4c9c76ac50d2bb3 (diff) | |
CLBlast: Add broadcast support for matrix multiplication (#3402)
Broadcast src0 into src1 across dimensions 2 and 3 when needed.
This is required for models that use GQA.
Diffstat (limited to 'examples/server/api_like_OAI.py')
0 files changed, 0 insertions, 0 deletions