Tag
#inference-economics
Reports tagged inference-economics.
Reports
5 reportsOct 2026
10-14 decision-models When is an agent's fast decision good enough? Additional reasoning is worth buying when a specific intervention can improve a consequential choice enough to justify its full cost. Confidence can help find those opportunities; it cannot price them by itself. Sep 2026
09-13 agent-harness When an Agent Fails, Should You Change the Model or the System? The useful distinction is not weak intelligence versus bad engineering. It is which intervention removes the failures that matter—and whether the gain survives realistic costs and checks. 09-07 model-routing Large Model, Small Model, or Both? The choice is never about how hard the task looks. It is an estimate of how well a candidate model will do, a threshold you own, and a bill you have to measure yourself. 09-07 agent-harness Can a Harness Make a Small Model Match a Large One? A harness is a bigger lever than most engineers assume, and the weaker model is the more exposed to it. Whether a small model can substitute is decided by the task, not the scaffolding. Aug 2026
08-22 reasoning How a Reasoner Learns When to Stop A full-parameter stop/refine policy learns from both repair and damage; sampling, search, and external verification remain isolated experiments around that control.