Tag
1 article tagged with Engineering.
Progressive tool discovery is usually sold on prompt caching. Keep the tools array fixed, the argument goes, and the cached prefix survives. I ran 72 benchmarks across gemini-3.5, 3.6 and 3.7 Flash at 14, 42, 84 and 280 tools. The fixed prefix cached in exactly zero of 36 runs, the pattern it argues against cached up to 93%, and the point where the pattern starts paying moved down to about 20 tools on the newest model.