diff options
| author | Kawrakow <iwankawrakow@gmail.com> | 2025-04-14 19:43:19 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2025-04-14 19:43:19 +0200 |
| commit | 05dbbeaf1489c55533adb5a032e077fab6cd95ad (patch) | |
| tree | 973c9c888b4c9f94b2b98b5bc1b4a7a89a563dee /examples/rpc | |
| parent | 028e0cfa196ae6adf6cf2f7c98110ef9e71acf91 (diff) | |
imatrix: collect layer influence statistics (#328)
* imatrix: collect layer influence statistics
* imatrix: collect layer influence statiscs also for the last layer
For the last layer we need to use the input for the output.weight
tensor. Last layer(s) tend(s) to be important, so it is useful to also
have its influence metric.
* imatrix: separate metric for attention and ffn importance
* Use stripped tensor name, not src0->name
---------
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'examples/rpc')
0 files changed, 0 insertions, 0 deletions