diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2024-10-26 17:40:32 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-10-26 17:40:32 +0200 |
| commit | 2e5f6db5de85de5cac416c93ae9ff02731498798 (patch) | |
| tree | d791151e7ea9601b149658c99d60e6a5633e41f1 /src/llama-sampling.cpp | |
| parent | bd309cb782ae8a5205dd741ccb97f6103f74888a (diff) | |
Bitnet: use the fused mul-silu in the FFN network (#110)
I had forgotten that build_bitnet() does not use the standerd
llm_build_ffn function, so the fused mul-silu didn't get used
for Bitnet when I added it to llm_build_ffn.
This gives us another ~1% speedup for TG-128.
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'src/llama-sampling.cpp')
0 files changed, 0 insertions, 0 deletions