This Week in Agents: Below the Model Layer

2026-10-16 · news · by Sho Byde

The release treadmill ran as usual: nineteen models shipped in the first half of October, by capitalandcompute's count. The three items I kept are all below the model layer: the system agents write code into, the way agent stacks make cheap routing calls, and the terms under which frontier-scale weights get released.

Anthropic rebuilt source control because its agents write too much code. Merged changes went from about 2,500 a day in May to over 30,000 in September, and a seven-person team built Scion and migrated the whole monorepo off git in five months. The design flip I find most interesting is their first principle, agents and jobs are always online so the server holds the repo's truth and clients fetch on demand, and Anthropic are upfront that the result is "by no means a suitable replacement for git for general use," pointing the rest of us at ideas to backport into git instead. Simon Willison heard Subversion in the description; the concrete idea is server-side query APIs for history and diffs, which a forge could ship without anyone changing their client.

Routing and classification got their own model class. On October 1, Cloudflare, AWS Strands Labs, and Perplexity each shipped an open-weight decision model that answers a typed question with a probability and bills input only, and the week added d3, Apache-2.0 sizes from 0.6B to 27B that generate no text at all. The category makes sense to me: agent stacks make thousands of yes-or-no and routing calls, and a calibrated probability with a threshold beats asking a chat model and parsing its prose. The pricing story is less tidy than the "free output" hook suggests, though: input dominates, and in capitalandcompute's cost model Clef comes out more expensive per 1,000 decisions than GPT-6 Luna answering with a short label.

Meta shipped an 816B-parameter open-weights MoE. Muse Spark Open has 42B active parameters per token, a 1M-token context, weights on Hugging Face, and the same $1.25/$4.25 per million tokens listed at every host serving it. The benchmark row tempers the headline: 39 on Artificial Analysis is the top US open-weight score, roughly level with DeepSeek V4.1 Flash at a third of the per-task cost, and nine points below Meta's own closed Muse Spark 1.3 at the same per-token price, per capitalandcompute's breakdown. The local-serving story is real but chunky: the reported desk setups pair two Mac Studios, Q4 weights need more memory than one 512GB Mac Studio holds, and the license asks for visible credit plus a separate deal for model-API businesses above $20 million in revenue.

One question to carry into next week: when does a git forge ship server-side history APIs, since that's the Scion idea the rest of us could adopt without abandoning git.

← back to shobyde.com