01 / 05
Local LLM bench lab
A tool that benchmarks local LLMs on llama.cpp from a single YAML file, and tells you which configuration wins and how to deploy it.
View code ↗01 / 05
A tool that benchmarks local LLMs on llama.cpp from a single YAML file, and tells you which configuration wins and how to deploy it.
View code ↗