Bonsai 27B brings 27-billion-parameter model inference to phones

xenova released Bonsai 27B, a quantized language model small enough to run on mobile devices without cloud dependency. For indie developers building AI features, this opens the door to shipping private, offline-capable applications without server costs.