Bonsai 27B brings a 27-billion-parameter model to phones

xenova released Bonsai 27B, a quantized large language model small enough to run locally on mobile devices. For indie developers building offline-first apps or trying to reduce API costs, having a capable model that doesn't require external servers opens new product possibilities.