Running Gemma 4 26B on 13-year-old Xeon hits 5 tokens/sec without GPU
Hacker News·1mo·neomindryan
A developer got Google's Gemma 4 26B model running on decade-old CPU hardware at usable speeds—no GPU required. This matters to indie makers running on constrained budgets or older servers: it's proof that you don't need cutting-edge hardware or cloud costs to experiment with capable LLMs.
Original story
Read the original on Hacker NewsRelated stories
AI
HYVE Ether OS goes on pre-sale: a $499 sovereign AI operating system you actually ownVibe Software Solutions·2mo·Anthony S. Owens

Open source
Geochemistry challenge to origin-of-life assumptions draws scrutinyHacker News·2mo·speckx

AI
Stanford releases open-source course on building language models from first principlesHacker News·2mo·kristianpaul