Which Agent's Skill Should Change? Group-Relative Credit Assignment for Evolving Multi-Agent Teams
Abstract
GRSE improves cooperative language agents by comparing repeated executions to correctly assign behavioral credit to agent-skill pairs, outperforming prior methods on multi-hop reasoning and recovering from harmful skills.
Cooperative language-model agents can improve without weight updates by revising reusable skills, but only if a shared team reward is traced to the responsible agent and skill. Existing methods credit the skills present in each trajectory, yet presence is not responsibility: a harmful skill active in successful runs still earns positive credit. We present GRSE, Group-Relative Skill Evolution, which assigns behavioral credit by comparison: inspired by GRPO, it executes each question several times under the same skill libraries and contrasts the executions to credit agent--skill pairs, with structured diagnosis of failures. On HotpotQA and LoCoMo with two open-weight actors, GRSE outperforms MASkills, the closest prior method, on HotpotQA and every LoCoMo category except open-domain, with the largest gains on multi-hop questions (+6.7 and +3.2 F1). Its gains rest on better-grounded retrieval rather than answers given without evidence, and its learned skills transfer between the multi-hop tasks. GRSE is robust to corrupted libraries: starting from planted harmful skills, it credits every planted skill with the correct sign and recovers the score of a clean library (+6.3 points), whereas MASkills misattributes two and falls below its starting point.
Community
๐ We present GRSE (Group-Relative Skill Evolution), a framework that tackles a fundamental question in multi-agent learning:
When a team succeeds or fails, which agent's skill should actually change?
Instead of rewarding all skills involved in successful trajectories, GRSE performs group-relative credit assignment across multiple executions to identify the skills that truly drive outcomes.
Key highlights:
๐ฏ Assigns credit at the agent-skill level
๐ Identifies causal contributors through trajectory comparison
๐ค Supports continual multi-agent skill evolution
๐ Outperforms existing skill-learning methods on HotpotQA and LoCoMo
๐ก๏ธ Remains robust under noisy and corrupted skill libraries
We believe GRSE is an important step toward scalable and self-improving multi-agent systems.
๐ Paper: https://arxiv.org/abs/2610.27227
๐ป Code: https://github.com/yananma1029/GRSE-Skills
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- UniSkill: Learning Actor-Aligned Skill Proposals for an Evolving Policy (2026)
- SkillFocus: Evolving Agent Skills via Capability Decomposition (2026)
- CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolution (2026)
- Matched-Context Group Policy Optimization for LLM Agent Training (2026)
- Credit Where Credit Is Due: Contrastive Attribution Topology Search for Multi-Agent Systems (2026)
- Towards Strategy-Level RSI for Skill-Augmented Agents: Learning When to Reuse Skills from Execution Feedback (2026)
- SkillNEO: Non-Elitist Evolutionary Optimization of Agent Skills (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.27227 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper