跳到正文
返回论文列表
cs.AI提交于 已译

消除迷雾:训练知识图谱智能体检索答案背后的证据

Clearing the FoG: Training KG Agents to Retrieve the Evidence Behind Their Answers

Zongyuan Sun · Shuai Zhao · Yingjun Du · Ke Shu · Ziyue Zhu · Haoran Luo

中文摘要

大语言模型(LLMs)虽能正确回答许多事实性问题,但正确答案未必有充分依据。知识图谱(KG)对智能体兼具答案来源与证据来源双重作用,但现有KG智能体仅将其视为答案源,训练数据缺乏证据,奖励机制仅校验答案,导致智能体常未检索支撑三元组即给出正确回答。FoG框架旨在训练KG智能体检索答案背后的证据,包含证据锚定合成、KG交互智能体及证据覆盖过程奖励(ECPR)。合成过程通过可验证子问题递归隐藏显式实体,确保每个问题天然包含支撑三元组;智能体记录KG返回的三元组;ECPR将每个支撑三元组奖励给首次检索到它的轮次。在三个KGQA基准上的实验表明,FoG使3B-4B开源智能体在答案准确率和证据覆盖率上显著超越更大规模的基线模型,并实现零样本跨KG迁移。

关键要点

  1. 01现有KG智能体训练仅关注答案正确性,缺乏对检索证据的约束,导致答案缺乏可追溯性。
  2. 02提出FoG框架,通过证据锚定合成生成天然包含支撑三元组的问题,并引入证据覆盖过程奖励机制。
  3. 03在三个KGQA基准上,3B-4B开源智能体在答案准确率和证据覆盖率上显著优于更大规模基线。
  4. 04实验验证了FoG框架具备零样本跨知识图谱迁移能力,提升了智能体回答的可审计性。

解读

尚无解读。

原始英文摘要

arXiv:2610.37405v1 Announce Type: new Abstract: Large language models (LLMs) can answer many factual questions correctly, but a correct answer is not necessarily a supported one. For an LLM agent, a knowledge graph (KG) plays two roles: as a source of answers, it supplies facts that the model lacks; as a source of evidence, it supplies the supporting triples that make an answer traceable and auditable. However, existing KG agents treat the KG only as a source of answers: their training data carries answers but not evidence, and their training rewards check the answer but not the retrieved evidence, so agents often answer correctly without retrieving the supporting triples. We propose FoG, a framework that trains KG agents to retrieve the evidence behind their answers. FoG consists of evidence-grounded synthesis, a KG interaction agent, and an evidence-coverage process reward (ECPR): the synthesis recursively hides explicit entities behind verifiable sub-questions, so that every question carries its supporting triples by construction; the agent records the triples returned by the KG; and ECPR credits each supporting triple to the turn that first retrieves it. Experiments on three KGQA benchmarks demonstrate that FoG enables 3B--4B open-source agents to outperform substantially larger baselines in answer accuracy and evidence coverage, with zero-shot cross-KG transfer.

同方向论文 · cs.AI

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 6

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Weekend Planner

- Read the weekend weather, calendar and budget. - Find local events, hikes, exhibitions and restaurants. - Propose 3 plans: adventure, cozy, social, with times and costs. - Prepare reservation steps; book nothing without approval. - Rememb…