A coding agent chooses a short verified path instead of opening a large pile of unnecessary files
A coding agent chooses a short verified path instead of opening a large pile of unnecessary files
+ AI News

E3 benchmark says agents waste tokens on simple tasks

A July 14 paper says estimate-first agent execution can match success while cutting cost, tokens, and inspected files on simple coding tasks.

A new July 14 paper argues that many coding agents do too much work before they do the right work.

The arXiv paper, “Do AI Agents Know When a Task Is Simple?”, proposes E3: Estimate, Execute, Expand. The idea is straightforward. An agent should estimate the smallest reliable scope for a task, execute that minimum path, and expand only if verification fails.

The authors frame the missing skill as task-aware execution-scope estimation. Instead of starting with a maximum-context-first strategy, the agent asks how difficult the task is, what information it truly needs, and what the shortest reliable path looks like.

The reported savings are large

On MSE-Bench, a deterministic benchmark of 121 edits in a controlled simulator, the authors report that E3 matched the strongest baseline’s 100% success rate while cutting cost by 85%, tokens by 91%, and inspected files by 92%.

The paper also describes a real-model harness called LLM-Case, where a live gpt-4o agent edits a real open-source library and patches are graded by running the project’s pytest suite against an oracle. The authors say the over-reading effect is milder there but still present, with E3 remaining the leanest and fastest policy at comparable task success.

Those numbers are author-reported. They should not be read as a benchmark of deployed commercial agents. The useful point is more general: agent quality is not only about final correctness. It is also about how much context, cost, time, and tool work the agent burns on the way there.

Minimum sufficient execution is a product problem

Many agent interfaces reward exhaustive behavior. The agent opens more files, gathers more context, writes a longer plan, and sounds safer. Sometimes that is exactly right. For ambiguous migrations, security-sensitive changes, or unknown codebases, the agent should broaden its view.

But simple tasks are different. A one-line fix does not always need a small codebase audit. Over-reading can slow the user down, increase token spend, hit rate limits, and expose more context than the task needs.

E3’s framing is valuable because it makes scope a first-class behavior. The agent starts small, verifies, and then earns additional exploration when the first path fails.

Sources

The AI Feed Desk

The AI Feed Desk

Editorial desk

The AI Feed Desk tracks AI provider updates, model releases, agent tooling, and enterprise adoption, turning fast-moving announcements into source-linked context for builders and operators.

Noticed a typo, incorrect information, or translation error?

Tell us so we can fix it.

Help Improve This Article

Related Articles

An MCP agent test bench replays clean, faulted, and mitigated tool responses

AgentCheck tests whether MCP agents fail safely

A July 13 paper introduces AgentCheck, an MCP workbench for replaying tool faults and confirming whether agent mitigations actually fix them.

The AI Feed Desk

By The AI Feed Desk

A Claude Opus 5 model control room routes coding, business, and research agent tasks through cost and safety controls

Claude Opus 5 becomes Anthropic's everyday agent model

Anthropic says Claude Opus 5 is available on Claude and the API at Opus 4.8 pricing, with stronger agentic coding and professional-work performance.

The AI Feed Desk

By The AI Feed Desk

A desktop agent workspace on a laptop branches into free, education, and key-based access paths

GitHub Copilot app reaches every plan

GitHub made the Copilot desktop app available across Copilot Free, GitHub Education, paid plans, and BYOK sessions without a Copilot subscription.

The AI Feed Desk

By The AI Feed Desk

A comment trigger, reasoning dial, and pull request checkpoint connect through a cloud agent workspace

GitHub gives Copilot cloud agent comment triggers and reasoning controls

GitHub added comment-triggered Copilot automations and per-task reasoning controls for Copilot cloud agent.

The AI Feed Desk

By The AI Feed Desk

A coding agent workflow loops through traces, grading, failure clusters, and approved fixes

Google gives coding agents an eval flywheel instead of another prompt tweak

Google's new quality-flywheel skill lets coding agents run structured agent evaluations with independent grading and production-trace loops.

The AI Feed Desk

By The AI Feed Desk