跳到正文
返回论文列表
cs.CV提交于 已译

基于无交互召回与文本引导重排序的高效遥感图像-文本检索

Efficient Remote Sensing Image-Text Retrieval via Interaction-Free Recall and Text-Guided Reranking

Xi Chen · Xu Chen · Xiamgyang Jia · Wei Wang · Xu Zhang · Zhenyuan Shun

中文摘要

遥感图像-文本检索在理解海量遥感影像中至关重要,但密集多目标分布与复杂背景使得细粒度跨模态对齐与高效检索难以兼顾。现有方法要么依赖复杂的跨模态交互导致效率低下,要么依赖大规模视觉-语言适配,需要大量数据和算力。为此,提出快速-精细(FTF)检索框架,核心为无交互多粒度召回与基于平衡文本引导交互块(BTIB)的无参数文本引导跨模态重排序。无交互多粒度召回预计算图库嵌入,并与查询嵌入匹配,避免全库token级文本-图像交互;文本引导重排序利用BTIB在Top-K候选集内细化局部语义对应。此外,设计模态间与模态内损失,联合优化多粒度表示的跨模态对齐。在公开基准上的大量实验表明,FTF在保持具有竞争力的检索精度的同时,显著提升了检索效率。

关键要点

  1. 01遥感图像密集多目标与复杂背景导致细粒度跨模态对齐与高效检索难以同时实现。
  2. 02提出FTF框架,结合无交互多粒度召回与基于BTIB的无参数文本引导跨模态重排序。
  3. 03设计模态间与模态内损失,联合优化多粒度表示的跨模态对齐。
  4. 04在公开基准上,FTF在保持具有竞争力的检索精度的同时显著提升了检索效率。

解读

尚无解读。

原始英文摘要

arXiv:2610.36756v1 Announce Type: new Abstract: Remote sensing (RS) image-text retrieval plays a critical role in understanding massive RS imagery. However, the dense multi-object distribution and complex backgrounds in RS imagery make it difficult to simultaneously achieve fine-grained cross-modal alignment and efficient retrieval. Existing methods either rely on complex cross-modal interactions that lead to low retrieval efficiency, or depend on large-scale vision-language adaptation, which requires massive data and computational resources. To address these issues, we develop a fast-then-fine (FTF) retrieval framework centered on interaction-free multi-granular recall and parameter-free text-guided cross-modal reranking with the Balanced Text-guided Interaction Block (BTIB). Specifically, interaction-free multi-granular recall pre-computes gallery embeddings and matches them with the corresponding query embedding without full-gallery token-level text-image interaction, while text-guided cross-modal reranking with BTIB refines local semantic correspondence within the top-K candidate set. Furthermore, an inter- and intra-modal loss is designed to jointly optimize cross-modal alignment across multi-granular representations. Extensive experiments on public benchmarks demonstrate that the FTF achieves competitive retrieval accuracy while significantly improving retrieval efficiency compared with existing methods.

同方向论文 · cs.CV

查看全部 →