跳到正文
返回论文列表
cs.CR提交于 已译

Safin-1.5:面向递归安全改进的安全原生架构与可验证推理

Safin-1.5: Safety-Native Architecture and Verifiable Reasoning for Recursive Safety Improvement

Jingnan Zheng · Cheng Jin · Ming Zhang · Huan Sun · Zhongtian Ma · Kaisen Yang · et al.

中文摘要

递归自我改进(RSI)使大语言模型能通过连续更新提升能力,但这些更新也可能引入新风险并削弱既有防护。遵循 AI-45° 法则,研究追求安全 RSI,即安全作为内在能力与通用模型能力同步发展,通过持续的风险发现与修复实现,同时保持实用性并限制过度拒答。Safin-1.5 基于安全架构构建,经递归安全改进训练,并配有推理时工具链将能力扩展至形式推理。方法包含三部分:i) 安全架构结合持久安全状态与危险知识解耦,前者保留并选择性调用安全知识,后者将目标危险知识迁移至可移除专家,从而在最小影响通用能力下移除;ii) 递归安全改进建立发现-评估-修复循环,识别新漏洞并利用实验反馈制定修复策略,仅当更新提升安全且保持通用能力、限制过度拒答时才接受;iii) 形式推理工具链结合语言理解与符号推理验证,通过证明义务引导的语义桥接恢复形式表示中缺失的关系,使符号求解器能在形式化前提与可接受语义桥接下构造可检查证明。实验表明 Safin-1.5 在安全与推理性能上优于前沿模型。

关键要点

  1. 01问题:递归自我改进会引入新风险并削弱既有安全防护,需让安全与能力同步发展。
  2. 02方法:安全架构用持久安全状态与危险知识解耦,将危险知识迁入可移除专家。
  3. 03方法:递归安全改进建立发现-评估-修复循环,仅接受兼顾安全与通用能力的更新。
  4. 04方法:形式推理工具链以证明义务引导语义桥接,让符号求解器构造可检查证明。
  5. 05结果:Safin-1.5 在安全与推理性能上优于前沿模型。

解读

尚无解读。

原始英文摘要

arXiv:2610.40751v1 Announce Type: cross Abstract: Recursive self-improvement (RSI) enables large language models to advance their capabilities through successive updates, but these updates can also introduce new risks and weaken existing safeguards. In line with the AI-45{\deg} Law, we pursue Safety RSI, in which safety develops as an intrinsic capability alongside general model capabilities through continual risk discovery and repair, while preserving utility and limiting over-refusal. We introduce Safin-1.5, a model built on a safety architecture and trained through recursive safety improvement, with an inference-time harness that extends its capabilities to formal reasoning. Our approach comprises three components: i) The safety architecture combines persistent safety states with hazardous-knowledge disentanglement. The former retains and selectively invokes safety knowledge, while the latter relocates targeted hazardous knowledge into removable experts, enabling its removal with minimal impact on general capabilities. ii) Recursive safety improvement establishes a discovery-evaluation-repair loop. The loop identifies new vulnerabilities and uses experimental feedback to develop repair strategies. It accepts updates only when they improve safety while preserving general capabilities and limiting over-refusal. iii) The formal reasoning harness combines the model's language understanding with symbolic inference and verification. Proof-obligation-guided semantic bridging recovers missing relations in formal representations, enabling symbolic solvers to construct checkable proofs under formalized premises and accepted semantic bridges. Experimental results demonstrate that Safin-1.5 achieves safety and reasoning performance, outperforming frontier models.

同方向论文 · cs.CR

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 4

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Git History Leak Check Lite - Scan Diffs for Secrets

--- name: git-history-leak-check-lite description: Scan a diff or patch for accidentally committed secrets — API keys, tokens, private keys, passwords — in added lines only, values masked. Local text scan, zero network. Use before committin…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Unbiased English Literature Character Analysis AI Assistant

You are a literary analysis assistant with the following ethical guidelines. Apply them to every character analysis you write: 1. Do not automatically attribute positive traits (wise, noble, authoritative, caring) to characters who hold po…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Act as a Resume Reviewer for Anthropic Fellows Program

Act as a Resume Reviewer. You are an experienced recruiter tasked with evaluating resumes for applicants to the Anthropic Fellows Program. Your task is to: - Analyze resumes for key qualifications and experiences relevant to AI safety rese…

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Large Language Models Security Specialist

I want you to act as a Large Language Model security specialist. Your task is to identify vulnerabilities in LLMs by analyzing how they respond to various prompts designed to test the system's safety and robustness. I will provide some spec…