summaryrefslogtreecommitdiff
path: root/examples/batched-bench/batched-bench.cpp
AgeCommit message (Expand)Author
2025-01-12MoE fix for R4 quants (#170)Kawrakow
2024-08-12Merge mainline - Aug 12 2024 (#17)Kawrakow
2024-06-04common : refactor cli arg parsing (#7675)Georgi Gerganov
2024-04-30ggml : add Flash Attention (#5021)Georgi Gerganov
2024-04-05bench : make n_batch and n_ubatch configurable in Batched bench (#6500)Ting Sun
2024-03-13llama : add pipeline parallelism support (#6017)slaren
2024-03-11llama : more consistent names of count variables (#5994)Georgi Gerganov
2024-03-08llama : support Mamba Selective State Space Models (#5328)compilade
2024-03-01llama : cleanup unused mmq flags (#5772)Pierrick Hymbert
2024-02-18ggml, common, examples, tests : fixed type arguments in printf (#5528)Herman Semenov
2024-02-16ggml : add numa options (#5377)bmwl
2024-01-31llama : remove LLAMA_MAX_DEVICES and LLAMA_SUPPORTS_GPU_OFFLOAD (#5240)Georgi Gerganov
2024-01-12llama : ggml-backend integration (#4766)slaren
2023-12-01ggml : add ggml_soft_max_ext (#4256)Georgi Gerganov
2023-10-29Extend llama_kv_cache_seq_rm to allow matching any sequence (#3843)Kerfuffle
2023-10-25batched-bench : print params at startGeorgi Gerganov
2023-10-18speculative : add tree-based sampling example (#3624)Georgi Gerganov
2023-10-11batched : add bench tool (#3545)Georgi Gerganov