词表已就位:适配预训练可解释特征用于生成式推荐
The Vocabulary Is Already Here: Adapting Pretrained Interpretable Features for Generative Recommendation
Ziluowen Luo · Ruochen Liu · Jun Yin · Hao Yan · Zhengxuan Hu · Xinze Shi · et al.
中文摘要
生成式推荐通过语义 ID (SID) 预测下一物品。现有方法需将 SID 词表拟合至预训练语言模型 (PLM) 表征,导致额外训练成本且词表覆盖受限于拟合领域。研究发现,预训练稀疏自编码器暴露出具有人类可解释语义标注的 PLM 特征,其特征索引可作为可复用的 SID 词表。复用该词表需解决紧凑 token 预算下保持物品区分度、在共享主导特征时优先目标物品,以及将特征可解释性从内容扩展至检索决策等问题。为此,提出 API 框架,无需额外词表学习即可实现有效且可解释的生成式推荐。API 中的预训练可解释 ID (PID) 保留选定的特征索引及相对激活强度以区分物品。语义预测适配器 (SPA) 以 PID 为监督,通过联合预测特征索引与强度从交互历史中学习用户偏好,并结合两者对候选物品评分,利用物品级监督确保观测到的下一物品排名高于其他候选。API 还通过特征贡献及其预训练语义标注解释候选分数差异。实验表明,API 在不同骨干网络和解码方案下均具有竞争力,在紧凑 token 预算下保持物品区分度并实现可解释检索。
关键要点
- 01指出现有生成式推荐需额外训练 SID 词表,且覆盖范围受限于拟合领域。
- 02利用预训练稀疏自编码器的可解释特征索引作为可复用的 SID 词表,避免额外学习。
- 03提出 API 框架,通过联合预测特征索引与强度,在紧凑 token 预算下保持物品区分度。
- 04实现可解释检索,通过特征贡献及预训练语义标注解释候选物品评分差异。
- 05实验显示 API 在不同骨干网络和解码方案下性能具有竞争力,无需额外词表学习。
解读
尚无解读。
原始英文摘要
arXiv:2610.36763v1 Announce Type: cross Abstract: Generative recommendation (GR) predicts the next item through its semantic ID (SID). Existing methods commonly fit SID vocabularies to pretrained language model (PLM) representations of item descriptions, incurring additional training costs and making vocabulary coverage dependent on the fitting domains. We observe that pretrained sparse autoencoders expose PLM features with human-interpretable semantic annotations, allowing feature indices to serve as a reusable SID vocabulary. However, reusing this vocabulary requires preserving item distinctions under compact token budgets and learning to favor target items over candidates with shared dominant features. It also requires extending feature interpretability from item content to retrieval decisions. To address these challenges, we propose API, a framework that Adapts the Pretrained Interpretable vocabulary for effective and explainable GR without additional vocabulary learning. Within API, Pretrained Interpretable IDs (PIDs) retain selected feature indices and relative activation strengths for item discrimination. With PIDs as supervision, the Semantic Prediction Adapter (SPA) learns user preferences from interaction histories through joint feature-index and strength prediction. SPA combines both predictions to score candidate items, with item-level supervision encouraging the observed next item to outrank its alternatives. API further explains candidate score differences through feature contributions paired with their pretrained semantic annotations. Extensive experiments show that API achieves competitive performance across backbones and decoding schemes, while preserving item distinctions under compact token budgets and enabling explainable retrieval.