跳到正文
返回论文列表
cs.IR提交于 已译

新颖还是非新颖?PatEx-Gym:用于专利审查新颖性评估的智能体先验技术检索

Novel or Not? PatEx-Gym: Agentic Prior-Art Search for Novelty Assessment in Patent Examination

Qiyao Wang · Xinyi Chen · Hongbo Wang · Jiayuan Lu · Jianhang Li · Minghuan Tan · et al.

中文摘要

专利审查要求智能体在异构科学与技术领域中寻找稀疏的现有技术、迭代修改查询、检查技术证据,并生成记录于审查意见通知书(Office Actions,OAs)中的新颖性评估,但现有基准多聚焦静态且有限的候选集,尚未充分覆盖完整的检索—推理—评估流程。PatEx-Gym 是首个面向专利审查智能体开发与评估的框架,集成三项组件:PatEx-Bench 提供 1K 项真实审查任务、两个分别含逾 1M 件专利和 52K 篇科学论文的大型检索语料库,以及支持迭代检索、文档访问、推理与 OA 生成的运行环境;无标注先验技术智能体检索轨迹合成框架 PASS 利用文档访问作为隐式相关性信号和证据获取锚点,刻画查询行为、检索推进及轨迹级证据与结果质量,生成 PatEx-SynData;在筛选轨迹上对 4B 规模的 PatEx-Agent 进行监督微调,建立轻量基线。实验显示,仅看最终决策准确率不足以完整反映审查质量,即使是强大的前沿模型也难以完成先验技术发现;该 4B 模型相较规模显著更大的通用智能体仍具竞争力,可作为先验技术检索与专利审查的紧凑基线。

关键要点

  1. 01现有基准侧重静态候选集,未覆盖完整的检索—推理—新颖性评估流程
  2. 02PatEx-Bench 含 1K 项真实任务、逾 1M 件专利及 52K 篇科学论文
  3. 03PASS 利用文档访问信号合成检索轨迹,无需人工标注
  4. 044B 规模的 PatEx-Agent 经监督微调后可媲美更大的通用智能体
  5. 05最终决策准确率不足以衡量审查质量,先验技术发现依然困难

解读

尚无解读。

原始英文摘要

arXiv:2610.33503v1 Announce Type: cross Abstract: Patent examination is a challenging real-world task that requires agents to discover sparse prior art, iteratively refine queries, inspect technical evidence, and produce novelty assessments documented in Office Actions (OAs) across heterogeneous scientific and technical domains. However, existing benchmarks largely focus on static and limited candidate sets, leaving the full search--reasoning--assessment process underexplored. We present PatEx-Gym, the first framework for developing and evaluating agents for patent examination, which integrates three components. First, PatEx-Bench provides 1K realistic examination tasks, two large-scale retrieval corpora containing over 1M patents and 52K scientific papers, and a harness runtime supporting iterative search, document visits, reasoning, and OA generation. Second, we introduce PASS, an annotation-free Prior-Art Agentic Search Trajectory Synthesis framework. Specifically, it exploits document visits as implicit relevance signals and evidence-acquisition anchors to model intra-turn query behavior, inter-turn search progression, and trajectory-level evidence and outcome quality, yielding PatEx-SynData. Third, we train PatEx-Agent at the 4B scale via supervised fine-tuning on the curated trajectories, establishing a lightweight baseline. Extensive experiments show that final decision accuracy alone does not fully reflect examination quality, while prior-art discovery remains difficult even for strong frontier models. Our PatEx-Agent achieves competitive performance against substantially larger general-purpose agents. These results show that training on PatEx-SynData enables a compact 4B model to serve as a competitive baseline for prior-art search and patent examination. We view patent examination as a demanding testbed for agentic search and deep research agents.

同方向论文 · cs.IR

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 5

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Paper to Practice

You turn research papers into practical takeaways for the user. - Topics are set by the user (edit this list): e.g. retrieval, agents, evaluation. - Each run, find new papers on arXiv and well-known lab blogs. Pick at most 5 that are likel…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Unified Research and Source Analysis Prompt

Unified, High-Precision Research & Analysis Prompt for ChatGPT and Perplexity AI ROLE & BEHAVIOR You are a professional researcher-analyst. Handle inputs as follows: * If the input is a URL/URI: open it fully with your browsing tool (e.g.…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

ISC Class 12th Exam Paper Analyzer and evaluator

Act as an ISC Class 12th Exam Paper Analyzer. You are an expert AI tool designed to assist students in preparing for their exams by analyzing exam papers and generating insightful reports. Your task is to: - Analyze submitted exam papers a…

数据github.com/f/awesome-chatgpt-prompts·外部收录·

Autonomous Research & Data Analysis Agent

Act as an Autonomous Research & Data Analysis Agent. Your goal is to conduct deep research on a specific topic using a strict step-by-step workflow. Do not attempt to answer immediately. Instead, follow this execution plan: **CORE INSTRUCT…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

LLM Researcher

I want you to act as an expert in Large Language Model research. Please carefully read the paper, text, or conceptual term provided by the user, and then answer the questions they ask. While answering, ensure you do not miss any important d…