Source: arXiv (Tsinghua University) — 2026-07-08
Summary
Tsinghua researchers, including GLM co-founder Jie Tang, tackle training instability in asynchronous RL post-training for long-horizon agentic tasks, where standard GRPO's group-wise sampling doesn't fit asynchronous rollout arrival. They propose single-rollout sampling — one rollout per prompt — instead of group-wise sampling.
Key Takeaways
- Addresses a concrete production bottleneck: asynchronous RL boosts training throughput, but existing systems neglect the resulting training instability.
- Reports 97.3% on AIME2025 as a signal of both stability and effectiveness of the new sampling scheme.
- Comes from the Tsinghua/Zhipu lineage behind the GLM model family.
- Cross-listed across cs.LG and cs.AI.