跳到正文
返回论文列表
cs.CL提交于 已译

少样本作者风格迁移的Steering向量与适配器权重预测

Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer

Leonard Popp · Danni Liu · Supriti Sinhamahapatra · Jan Niehues

中文摘要

从少量示例适应大型语言模型到个体作者风格具有挑战性,科学写作尤其困难:正式规范留有的表面变化很小,且作者围绕自己的主题写作,因此提取的"风格"容易与内容纠缠。研究从每位作者的几个示例摘要中进行风格条件化摘要生成,提出三种方法:(1)对比激活steering,(2)预测steering向量的网络,(3)预测LoRA适配器的超网络。发现风格模仿与输出质量之间存在一致的权衡:微调获得了大部分可用风格信号但牺牲了流畅性,而超网络在可见和不可见作者上都实现了最佳权衡。Steering在作者层面运作,将同一内容的作者摘要与风格中性生成进行对比。这保持主题固定,无需预定义风格清单,优于基于清单的steering。此外,分析表明手动提取和预测的steering向量几乎正交但得分相当,表明这里的风格调节可以至少有两条不相关方向,而非需要一条特定轴。

关键要点

  1. 01问题:科学写作正式规范变化小,作者主题与风格纠缠,少样本风格迁移困难
  2. 02方法一:对比激活steering,将同一内容作者摘要与风格中性生成对比,无需预定义风格清单
  3. 03方法二:预测steering向量的网络,与手动提取向量正交但效果相当
  4. 04方法三:预测LoRA适配器的超网络,在可见和不可见作者上都获最佳权衡
  5. 05发现:风格模仿与输出质量存在权衡,微调获风格信号但失流畅性,超网络平衡最佳

解读

尚无解读。

原始英文摘要

arXiv:2610.03163v1 Announce Type: new Abstract: Adapting large language models to an individual author's style from a few examples is challenging, and scientific writing sharpens the difficulty: formal conventions leave little surface variation, and authors write about their own topics, so extracted ``style'' easily entangles with content. We study style-conditioned abstract generation from a few example abstracts per author and propose three methods: (1) contrastive activation steering, (2) a network that predicts steering vectors, and (3) a hypernetwork that predicts LoRA adapters. We find a consistent trade-off between style imitation and output quality: fine-tuning buys most of the available style signal but forfeits fluency, while the hypernetwork achieves the best trade-off on both seen and unseen authors. Our steering operates at author level, contrasting an author's abstracts against style-neutral generations for the same content. This holds topic fixed, removes the need for a predefined style inventory, and outperforms inventory-based steering. % [EDIT 1a] softened "no single optimal axis" claim Moreover, our analyses demonstrate that manually extracted and predicted steering vectors are near-orthogonal yet score comparably, indicating that style conditioning here can admit at least two unrelated directions rather than requiring one particular axis.

同方向论文 · cs.CL

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 5

学习github.com/f/awesome-chatgpt-prompts·外部收录·

Customer Interview Insight Extractor (JSON)

{ "role": "Senior product researcher who turns raw customer interview transcripts into evidence-backed, decision-ready insights", "task": "Read one customer interview transcript (or detailed notes) and extract structured insights as a s…

写作github.com/f/awesome-chatgpt-prompts·外部收录·

Incident Timeline Writer

--- name: incident-timeline-writer description: Turn rough incident notes into a clear timeline, impact summary, and follow-up actions. --- # Incident Timeline Writer Help write post-incident narratives from messy notes, Slack dumps, or p…

写作github.com/f/awesome-chatgpt-prompts·外部收录·

Article Summary and Comprehension

Act as an Article Summarizer and Comprehension Expert. You are skilled in extracting key information from written content and providing insightful summaries. Your task is to summarize the article titled '${articleTitle}' and provide a comp…