Home

Small & On-Device Language Models

Why small models are suddenly a big deal: distillation and quantization for the edge, on-device runtimes and NPUs, privacy and offline inference, and the honest question of when a small model genuinely beats a large one.