跳到正文
返回论文列表
cs.AI提交于 已译

食物相似性的构成:印度菜中的视觉表征与检索

What Constitutes Food Similarity? Visual Representations and Retrieval in Indian Cuisine

Saransh Kumar Gupta · Akshadha Sharma · Lipika Dey · Partha Pratim Das · Ramesh Jain

中文摘要

食物相似性是检索、推荐、替换等食物计算任务的基础,但食物表征通常以身份保持来评估。研究追问超越身份的食物相似性:不同视觉表征如何将食物组织成关系邻域,这些邻域揭示或掩盖了哪些烹饪关系,以及这些结构在不同表征间的一致性如何。印度菜提供了具有挑战性的场景:视觉相似的食物可能具有不同的烹饪身份,而同一烹饪家族内的食物外观可能差异很大。使用扩展的 Khana 数据集和七种预训练视觉表征(涵盖卷积、基于 transformer、自监督和图文对齐模型),评估图像到图像检索和图像到菜肴邻域,考察烹饪家族结构、对比案例和跨表征一致性。还聚合图像表征以比较模型间的菜肴级视觉相似性,并与同一菜肴的食谱衍生相似性对比。图像级邻域在不同表征间差异显著,包括跨烹饪家族边界的相似性。在菜肴级,聚合揭示了尽管存在局部变化但共同的视觉结构,然而该结构与食谱衍生相似性的对应较弱。这些发现表明,仅凭识别性能无法表征关系结构:食物相似性取决于表征、模态和抽象层次,而非食物集合的固定属性。因此,理解这些结构是将多种食物信息模态组合成连贯相似性概念的前提。

关键要点

  1. 01现有食物表征评估多关注身份保持,忽略了超越身份的关系结构。
  2. 02使用七种预训练视觉模型在印度菜数据集上评估图像检索与菜肴邻域。
  3. 03图像级邻域跨表征差异大,菜肴级聚合揭示共同视觉结构但弱对应食谱相似性。
  4. 04食物相似性取决于表征、模态和抽象层次,非食物集合固定属性。
  5. 05理解关系结构是融合多模态食物信息构建连贯相似性概念的前提。

解读

尚无解读。

原始英文摘要

arXiv:2610.37867v1 Announce Type: new Abstract: Food similarity underlies retrieval, recommendation, substitution, and other food computing tasks, yet food representations are typically evaluated by identity preservation. We ask what happens to food similarity beyond identity: how different visual representations organize foods into relational neighborhoods, what culinary relationships these neighborhoods reveal or obscure, and how consistently these structures emerge across representations. Indian cuisine provides a challenging setting in which visually similar foods may have different culinary identities, while foods within a culinary family can vary substantially in appearance. Using an expanded Khana dataset and seven pretrained visual representations spanning convolutional, transformer-based, self-supervised, and image-text aligned models, we evaluate image-to-image retrieval and image-to-dish neighborhoods, examining culinary-family structure, contrast cases, and cross-representation agreement. We also aggregate image representations to compare dish-level visual similarity across models and against recipe-derived similarity for the same dishes. Image-level neighborhoods vary substantially across representations, including similarities across culinary-family boundaries. At the dish level, aggregation reveals common visual structure despite local variation, but this structure corresponds less strongly with recipe-derived similarity. These findings show that recognition performance alone cannot characterize relational structure: food similarity depends on representation, modality, and abstraction level rather than being a fixed property of the food collection. Understanding these structures is therefore a prerequisite to combining multiple food information modalities into a coherent notion of similarity.

同方向论文 · cs.AI

查看全部 →