Tag: case-studies
All the articles with the tag "case-studies".
-
When Accuracy Misleads: Cost Matrix Metrics and Thresholds
• UpdatedWhen does accuracy mislead? A sealed, pre-registered SECOM evaluation: the top model by accuracy catches zero defects until the threshold matches costs.
-
Pay-Per-Call APIs: $0.005 Calls, Measured Treasury Costs
• UpdatedSub-cent API calls clear the card fee floor and settle at request; measured USDC off-ramp sweeps show deterministic treasury costs for pay-per-call revenue.
-
When Should an AI Agent Enumerate, and When Delegate?
• UpdatedA sealed 240-call exhibit grounds the boundary between decision spaces an agent should enumerate exactly and those it should delegate to a typed judge.
-
Does WebMCP Pay Off for Content Sites?
• UpdatedAcross 135 agent runs on a production blog, shrinking a four-tool WebMCP surface yielded little median-token benefit; relevance ordering mattered more.
-
How Much Tool Documentation Do AI Agents Actually Need?
• UpdatedTrimming MCP tool-definition prose cut cold-call input tokens 12-14% with no statistically detectable accuracy loss across two model tiers.
-
Open-Weight LLMs Reach the Structured Output Quality Ceiling
• UpdatedOpen-weight models now match closed-source on structured output at 95x lower cost. Pre-registered blind eval, 30 samples, zero quality delta.