跳到正文
返回论文列表
cs.AI提交于 已译

部分可观测下时序知识图谱记忆的神经符号元策略

Neuro-Symbolic Meta-Policies for Temporal Knowledge-Graph Memory under Partial Observability

Taewoon Kim · Vincent Fran\c{c}ois-Lavet · Michael Cochez

中文摘要

部分可观测强化学习需要随时间决定保留、检索和遗忘哪些信息。引入一种神经符号元策略(meta-policy),在每个决策点学习应用哪种符号记忆启发式,同时保持执行过程符号化。实验设置采用 RoomKG 中的时序知识图谱(temporal knowledge-graph)记忆,隐藏状态与观测表示为 RDF 图,记忆通过时序 RDF 三元组标注增强。模型将记忆内容的知识图谱编码与用于问答、探索和遗忘的价值头(value head)结合,得到既自适应又可检查的控制器。该工作通过基于 RDF 的表示、兼容标注的图语义以及对显式记忆状态的图符号操作,获得直接的语义网(Semantic Web)基础。在长期记忆容量为 512 的训练/测试房间划分上,限定符感知的 StarE-GNN 配置在对比的符号、神经和神经符号系统中取得最佳留出性能,同时保留记忆管理决策的步级可追溯性。

关键要点

  1. 01问题:部分可观测强化学习需随时间决定记忆的保留、检索与遗忘。
  2. 02方法:神经符号元策略学习选择符号记忆启发式,执行仍保持符号化。
  3. 03实现:RoomKG 中以 RDF 图表示状态与观测,记忆带时序三元组标注。
  4. 04结果:记忆容量 512 下 StarE-GNN 配置留出性能最佳且决策可追溯。

解读

尚无解读。

原始英文摘要

arXiv:2607.18368v5 Announce Type: replace Abstract: Partially observable reinforcement learning requires deciding what to retain, retrieve, and forget over time. We introduce a neuro-symbolic meta-policy that learns which symbolic memory heuristic to apply at each decision point while keeping execution symbolic. Our setting uses temporal knowledge-graph memory in RoomKG, where hidden state and observations are represented as Resource Description Framework (RDF) graphs and memory is augmented with temporal RDF triple annotations. The model combines knowledge-graph encoding of memory contents with value heads for question answering, exploration, and forgetting, yielding a controller that is both adaptive and inspectable. This gives the work a direct Semantic Web grounding through RDF-based representation, annotation-compatible graph semantics, and graph-based symbolic operations over explicit memory state. On train/test room splits at long-term memory capacity of 512, the qualifier-aware StarE-GNN configuration achieves the best held-out performance among the compared symbolic, neural, and neuro-symbolic systems while preserving step-level traceability of memory-management decisions.

同方向论文 · cs.AI

查看全部 →