Tool ranks local LLMs by actual benchmark performance on your hardware
Hacker News·1w·andyyyy64
A new GitHub project helps developers match local language models to their specific machine specs using real benchmark data instead of guessing. For makers running inference on-device, this cuts through marketing noise and points to what actually works fastest on your hardware.
Original story
Read the original on Hacker News