跳到正文
返回论文列表
cs.LG提交于 已译

将预训练全原子表示泛化到统一结合剂设计

Towards Generalizing Pretrained All-Atom Representations to Unified Binder Design

Maojiang Su · Jiale Chen · Qijie Zhu · Shang Wu · Jiayi Wang · Jihai Zhao · et al.

中文摘要

基于 PairFormer 的全原子模型在生物分子结合剂设计中表现强劲,但现有方法多将全原子表示用于特定模态的结合剂设计,如蛋白质与多肽设计。近期几何隐扩散模型则通过在不同模态的分子块共享隐空间来实现统一结合剂设计。受两者互补优势启发,研究如何将预训练全原子表示泛化用于统一结合剂设计。提出 PairFuse,一种参数高效方法,通过表示融合实现该泛化:用轻量级逐层适配器将预训练全原子表示集成到独立预训练的几何隐扩散模型中。适配器通过两种机制融合表示:丰富扩散模型的分子块特征,以及将成对结构信息注入几何扩散模型的去噪器。理论上证明增强后的去噪器保持几何性质,且成对注意力融合比仅特征融合提供额外注意力表达能力。在抗体、多肽和小分子结合剂设计基准上,PairFuse 性能优于预训练扩散模型和现有表示融合基线。

关键要点

  1. 01现有全原子模型多用于特定模态结合剂设计,几何隐扩散模型追求统一设计,两者优势互补但尚未结合。
  2. 02PairFuse 用轻量级逐层适配器将预训练全原子表示融入独立预训练的几何隐扩散模型,参数高效。
  3. 03适配器通过丰富分子块特征和注入成对结构信息两种机制融合表示。
  4. 04理论证明增强去噪器保持几何性质,成对注意力融合提供额外表达能力。
  5. 05在抗体、多肽、小分子结合剂设计基准上优于预训练扩散模型和表示融合基线。

解读

尚无解读。

原始英文摘要

arXiv:2610.37994v1 Announce Type: cross Abstract: PairFormer-based all-atom models demonstrate strong capabilities in biomolecular binder design. However, existing methods often use all-atom representations for modality-specific binder design, such as protein and peptide design. In contrast, recent geometric latent diffusion models pursue unified binder design by representing molecular blocks from different modalities in a shared latent space. These complementary strengths motivate us to investigate how to generalize the use of pretrained all-atom representations to unified binder design. We introduce PairFuse, a parameter-efficient method that enables this generalization through representation fusion. Specifically, we use lightweight layerwise adapters to integrate pretrained all-atom representations into an independently pretrained geometric latent diffusion model. Our adapters integrate pretrained all-atom representations through two mechanisms: enriching the diffusion model's molecular block features and incorporating pairwise structural information into the geometric diffusion model's denoiser. Theoretically, we prove that the augmented denoiser preserves geometry and pairwise attention fusion provides additional attention expressivity beyond feature-only fusion. Experimentally, across antibody, peptide, and small molecule binder-design benchmarks, PairFuse achieves stronger performance than the pretrained diffusion model and existing representation-fusion baselines.

同方向论文 · cs.LG

查看全部 →