diff options
| author | Iwan Kawrakow <iwan.kawrakow@gmail.com> | 2024-06-11 09:12:22 +0200 |
|---|---|---|
| committer | Iwan Kawrakow <iwan.kawrakow@gmail.com> | 2024-06-22 12:02:50 +0300 |
| commit | ad53eabf87816705f49501a54c7555c337bb47ce (patch) | |
| tree | d5500fa26360272673c599eb6bbec4046023d806 /iqk_mul_mat.h | |
| parent | 3593891f390b376f7127efe3bd7eda9baffe6609 (diff) | |
iqk_mul_mat: be independent of llamafile_sgemm (WIP)
* Remove iqk_mul_mat from llamafile_sgemm
* Pass tensor types and strides to iqk_mul_mat
It is marked WIP because only tested on __aarch64__
Diffstat (limited to 'iqk_mul_mat.h')
| -rw-r--r-- | iqk_mul_mat.h | 10 |
1 files changed, 7 insertions, 3 deletions
diff --git a/iqk_mul_mat.h b/iqk_mul_mat.h index 4706714b..c1db5eee 100644 --- a/iqk_mul_mat.h +++ b/iqk_mul_mat.h @@ -5,11 +5,15 @@ extern "C" { #endif -bool iqk_mul_mat(long Nx, long Ny, long ne00, int typeA, const void * A, const void * B, +bool iqk_mul_mat(int task_type, long Nx, long Ny, long ne00, + int typeA, const void * A, long strideA, + int typeB, const void * B, long strideB, float * C, long stride_C, int ith, int nth); -bool iqk_mul_mat_moe(long, long, long, int, int, const void *, const void *, - float *, long, long, const void *, int, int); +bool iqk_mul_mat_moe(long Nx, long Ny, long ne00, int ne11, + int typeA, const void * A, long strideA, + int typeB, const void * B, long strideB, + float * C, long nb1, long nb2, const void * vrow_mapping, int ith, int nth); #ifdef __cplusplus |