Microsoft 与 Hugging Face 用数据库终态奖励后训练 ThinkingBox 智能体
Microsoft 与 Hugging Face 将 ThinkingBox 的数据库终态检查转化为训练奖励,并对 Qwen3.8-27B 进行 50 步 GRPO 微调。
推荐理由:文章把数据库终态检查转化为训练奖励,公开完整训练流程,并同时量化重复成功率、覆盖率与成本变化。
Long-Horizon-Terminal-Bench 2.0: Automating Diverse Task Construction and Measuring Sustained Agent Progress
Zongxia Li · Zhongzhi Li · Yucheng Shi · Ruhan Wang · Junyao Yang · Chengsong Huang · et al.
长时程终端基准旨在衡量智能体能否通过过程奖励在扩展工作流中维持进展,而非仅检查最终状态。Long-Horizon-Terminal-Bench 2.0 (LHTB 2.0) 保留了46个原始任务,修复了缺陷并扩展了31个任务,共包含13个领域的77个任务。扩展任务通过系统性重构管道生成:从可用工件出发,利用参数化参考实现生成场景,展示6个作为行为证据,保留3个用于评估,并使用密集进度阶梯奖励部分进展以防止记忆。评估时长从90分钟延长至3小时,每30分钟记录验证点。在15个前沿模型的1,145次运行中,GPT-6-astra以0.69的密集平均奖励领先,37个任务得分≥0.95;GPT-5.6-sol紧随其后。在30个重构任务中,二元验证器平均分0.221,而密集阶梯平均分0.653,表明仅结果评估丢弃了大量中间进展。LHTB 2.0提供了更广泛、强化且过程感知的测试平台。
尚无解读。
arXiv:2610.14146v1 Announce Type: new Abstract: Long-horizon terminal benchmarks measure whether an agent can sustain progress through extended workflows with process rewards, not only whether its final state passes a binary check. We present Long-Horizon-Terminal-Bench 2.0 (LHTB 2.0), an extension of Long-Horizon-Terminal-Bench that preserves its 46 original tasks while correcting task and evaluation-infrastructure defects and extending 31 tasks. LHTB 2.0 contains 77 tasks across 13 domains and eight task types. The extended tasks are produced through a systematic reconstruction-task pipeline. We start from a working scientific or engineering artifact, then use a parameterized reference implementation to generate multiple scenarios, reveal six as behavioral evidence, hold out three for evaluation, and use dense progress ladders to reward partial progress while preventing memorization of public outputs. We also extend the evaluation horizon from 90 minutes to three hours and record verifier checkpoints every 30 minutes, enabling direct measurement of sustained progress within a run. Across 1,145 scored model-task runs from 15 frontier models, GPT-6-astra leads with dense mean reward 0.69 and 37 tasks at R at least 0.95, followed by GPT-5.6-sol with dense mean reward 0.67 and 32 tasks at the same threshold. On the 30 reconstruction tasks, binary verifier scores average 0.221, whereas dense ladder scores average 0.653, showing that outcome-only evaluation discards substantial intermediate progress. LHTB 2.0 provides a broader, hardened, and process-aware testbed for studying reliable agent execution over hours.
Microsoft 与 Hugging Face 将 ThinkingBox 的数据库终态检查转化为训练奖励,并对 Qwen3.8-27B 进行 50 步 GRPO 微调。
推荐理由:文章把数据库终态检查转化为训练奖励,公开完整训练流程,并同时量化重复成功率、覆盖率与成本变化。
I wanna build an AI that can learning a deck in Master duel called Kewl Tune that can win against pro players with differents decks , This AI can build combos and evo his level with a tool called ygo agent on git hub and with Kaggle Noteboo…