Local-first

Routing a prompt between Gemini Nano and the cloud

Chrome and Edge both ship a language model, and the AI SDK makes swapping one for a cloud model a one-line change. The interesting part is the router that decides which one runs, and every constant in it comes from a measurement.