三维网格的几何纹理分割
Segmenting Geometric Textures of 3D Meshes
Weidan Xiong · Kaijie Qu · Shihao Feng · Shunqi Fan · Rongyu Xiong · Hui Huang
中文摘要
识别三维模型上的几何纹理模式对文物保护、模型编辑和3D打印等应用至关重要。现有三维模型分割方法主要关注高层语义部件,无法捕捉中层纹理。尽管近期视觉语言模型(Vision-Language Model)能借助合适的文本提示进行图像分割,但仍难以识别三维几何纹理。本工作提出一种基于中层几何纹理分割三维网格模型的方法,并引入新的几何纹理分割基准(benchmark),据此微调 SAM3。分割出的纹理区域随后依据 DINO 特征相似度聚类,并从2D提升到3D。此外,开发了一个交互工具,可基于分割结果进行三维模型编辑,并依据几何与纹理相似度从数据集中检索模型。实验表明,该方法在几何纹理分割上显著优于现有方法,并能支撑多种应用。
关键要点
- 01现有三维分割方法聚焦高层语义部件,难以捕捉中层几何纹理。
- 02提出基于中层几何纹理的三维网格分割方法,并构建新基准微调 SAM3。
- 03分割区域用 DINO 特征相似度聚类,再从2D提升到3D。
- 04实验显示该方法在几何纹理分割上显著优于现有方法。
- 05开发交互工具支持基于分割的模型编辑与几何纹理相似度检索。
解读
尚无解读。
原始英文摘要
arXiv:2611.08897v1 Announce Type: cross Abstract: Recognizing geometric texture patterns on 3D models is critical for applications such as heritage protection, model editing, and 3D printing. Existing 3D model segmentation methods predominantly focus on identifying high-level semantic parts, thereby failing to capture middle-level textures. While recent Vision-Language Models can perform image segmentation with appropriate text prompts, they still struggle to recognize 3D geometric textures. In this work, we present a method that segments 3D mesh models based on middle-level geometric textures. We further introduce a new geometric texture segmentation benchmark and fine-tune SAM3 accordingly. The segmented texture regions are then clustered based on DINO feature similarity and lifted from 2D to 3D. Additionally, we develop an interactive tool to enable both 3D model editing based on our segmentation results and model retrieval from the dataset based on geometric and texture similarity. Experiments demonstrate that our method significantly outperforms existing methods in segmenting geometric textures and can facilitate various applications.