BenchLocal

Test LLMs on real tasks. Compare models side-by-side.

A local LLM benchmarking tool for running side-by-side tests of locally hosted models, with benchmark packs and result visualizations.

Recent stories

1 linked story

releasePRIMARY2026-05-17

BenchLocal releases v0.2.6 with offline-skip runs for tight-VRAM tests

BenchLocal v0.2.6 adds reachability checks so offline local models are skipped and resumed instead of breaking side-by-side tests. The update is aimed at tight-VRAM setups where creators and tinkerers load providers one after another on the same machine.