Source: arXiv — 2026-07-13
Summary
StructAgent, from researchers at UC San Diego and Aether AI Lab, tackles a core failure mode of long-horizon computer-use agents: they operate over raw interaction history — every observation, edit, and failed attempt piled up in sequence — which makes task progress hard to interpret, verify, or recover from. Instead, StructAgent maintains a unified, compact causal state of task progress, with a structured workflow that gates every state transition through a verifier. The gains are large: on long-horizon computer-use tasks, Qwen3.5-9B jumps from 27.0% to 46.9% success, and Qwen3.5-27B jumps from 31.6% to 62.2%, with a new open-source SOTA of 78.9% using MiniMax-M3.
Key Takeaways
- The core diagnosis: raw interaction history (every observation, intermediate edit, and failed attempt logged in sequence) makes it hard for an agent to know how much progress it's actually made or cleanly recover from a failure — the history grows but doesn't compress into anything actionable.
- The fix is architectural, not just prompting: a "unified causal structure" representing task progress compactly and verifiably, replacing the ever-growing raw log with a state that's small enough to reason over and precise enough to verify.
- Every state transition is verifier-backed — the agent doesn't just claim progress, a separate verification step confirms it before the state updates, which is what enables clean failure recovery instead of cascading errors.
- Results are large and consistent across model sizes: Qwen3.5-9B improves 27.0% → 46.9%, Qwen3.5-27B improves 31.6% → 62.2%, and the approach sets a new open-source state-of-the-art of 78.9% paired with MiniMax-M3. It also generalizes beyond typical computer-use benchmarks to Minecraft-style long-horizon tasks.
Reel Script
Hook: Nearly doubling an agent's success rate on long, multi-step tasks didn't come from a bigger model — it came from changing what the agent remembers.
Core Concept: Most long-horizon agents track progress the same way: a growing log of every observation, edit, and failed attempt, in order. The problem is that a raw log isn't the same as understanding — it's like trying to figure out if a construction project is on schedule by reading every worker's timestamped notes instead of looking at a project plan. StructAgent replaces that raw log with a causal state: a compact representation of what's actually been accomplished and what still depends on what, plus a verifier that checks each claimed step before the agent's state updates to reflect it.
Hands-On: The architecture is a state-and-workflow pair, not just a bigger context window. The agent doesn't act directly on its history; it acts on a maintained causal state, and every transition of that state has to clear a verification check before it's accepted — so if the agent thinks it completed a step but actually didn't, that gets caught at the state layer instead of silently corrupting everything downstream. The results make the case: on long-horizon computer-use tasks, Qwen3.5-9B goes from 27.0% to 46.9% success, and Qwen3.5-27B goes from 31.6% to 62.2% — roughly doubling success rate at both model sizes just by changing the state representation, not the underlying model. Paired with MiniMax-M3, the approach sets a new open-source state-of-the-art at 78.9%, and the method transfers to a completely different long-horizon domain (Minecraft-style tasks), suggesting the causal-state idea isn't overfit to one benchmark.
Takeaway: If your agent's failure mode on long tasks is "it loses the thread halfway through," the fix worth trying isn't a bigger context window — it's a structured, verified state representation instead of a raw history log. This is the kind of architecture change worth prototyping before you reach for a more expensive model to paper over the same problem.