Tag
Engineering
4 articles tagged with Engineering.
Jev, the model that can't write
Jev is a model that cannot generate a single word of text. It picks from options you give it and returns a probability for each, dozens of questions per call, in a few hundred milliseconds. To see what that's good for I gave it a gamebook to referee: you type anything, Jev decides what you meant, whether it would work, and what it says about you.
Musubi: a history of everything you asked
I have thousands of conversations with AI tools scattered across four applications. Musubi reads all of them, distils them, and hands the result back to any agent over MCP, with nothing ever leaving the machine.
Routing a prompt between Gemini Nano and the cloud
Chrome and Edge both ship a language model, and the AI SDK makes swapping one for a cloud model a one-line change. The interesting part is the router that decides which one runs, and every constant in it comes from a measurement.
MCP's Progressive Tool Discovery
Progressive tool discovery is usually sold on prompt caching. Keep the tools array fixed, the argument goes, and the cached prefix survives. I ran 72 benchmarks across gemini-3.5, 3.6 and 3.7 Flash at 14, 42, 84 and 280 tools. The fixed prefix cached in exactly zero of 36 runs, the pattern it argues against cached up to 93%, and the point where the pattern starts paying moved down to about 20 tools on the newest model.