跳到正文
返回论文列表
cs.CV提交于 已译

从噪声测量中学习干净的生成过程

Learning Clean Generative Processes from Noisy Measurements

Fabian Kruse · Lorenzo Baldassari · Ivan Dokmani\'c

中文摘要

研究仅用噪声观测学习干净图像生成模型的问题。扩散过程及其对非高斯噪声的推广需要在每个噪声水平上做后验预测。首先证明,可用 Noise2Noise 回归从独立噪声视图学习这些预测,但仅限训练数据噪声水平及以上。为学习生成干净图像所需的更低噪声水平预测,引入一致性约束:预测应等于继续采样过程后的期望。推导出一致性唯一确定向干净图像分布延续的条件,并在 Poisson、binomial、Gamma 和 negative-binomial 测量上验证。在 CIFAR-10、光子计数显微和合成孔径雷达上的实验表明,所需后验预测可仅从噪声视图学习,且一致性关系能修复超出数据噪声水平的延续,而无一致性时该延续严重退化。

关键要点

  1. 01问题:仅用噪声观测学习干净图像生成模型,低噪声水平后验预测难以获得
  2. 02方法:用 Noise2Noise 回归学习预测,并加一致性约束延续到干净分布
  3. 03结果:在 Poisson、binomial、Gamma、negative-binomial 测量上验证一致性条件
  4. 04结果:CIFAR-10、光子计数显微和合成孔径雷达实验验证方法有效
  5. 05局限:Noise2Noise 回归仅能在训练数据噪声水平及以上学习预测

解读

尚无解读。

原始英文摘要

arXiv:2610.42036v1 Announce Type: cross Abstract: We study how to learn a generative model of clean images using only noisy observations. Diffusion processes and their generalizations to non-Gaussian noise require posterior predictions at every noise level. We first show that it is possible to learn these predictions from independent noisy views using Noise2Noise regression, but only at or above the noise level of the training data. To learn the predictions below that level, needed to generate clean images, we impose consistency: a prediction should equal its expectation after continuing the sampling process. We derive conditions under which consistency uniquely determines the continuation to the clean image distribution and verify them for Poisson, binomial, Gamma, and negative-binomial measurements. Experiments on CIFAR-10, photon-counting microscopy, and synthetic aperture radar show that the required posterior predictions can be learned from noisy views alone and that the consistency relation repairs the continuation beyond the noise level of the data, which severely deteriorates without consistency.

同方向论文 · cs.CV

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 6

图像github.com/f/awesome-chatgpt-prompts·外部收录·

Professional photo restoration expert

Act as a professional photo restoration expert. You are tasked with performing a high-precision conservative restoration and historical colorization of a degraded vintage photograph. The final image should resemble a perfectly preserved ori…

图像github.com/f/awesome-chatgpt-prompts·外部收录·

Ultra-High-Resolution Portrait Restoration

{ "prompt": "Restore and fully enhance this old, blurry, faded, and damaged portrait photograph. Transform it into an ultra-high-resolution, photorealistic image with HDR-like lighting, natural depth-of-field, professional digital studio …

图像github.com/f/awesome-chatgpt-prompts·外部收录·

Cinematic 3x3 Focal Lengths Grid

<instruction> Analyze the entire composition of the input image. Identify ALL key subjects present (whether it's a single person, a group/couple, a vehicle, or a specific object) and their spatial relationship/interaction. Generate a cohesi…

图像github.com/f/awesome-chatgpt-prompts·外部收录·

3D Mechanical Part Image to Technical Drawing Conversion

{ "task": "image_to_image", "input_image": "3d_render_of_mechanical_part.png", "prompt": "Reference scale: the outer diameter of the flange is exactly 360 mm. Mechanical engineering drawing sheet with three separate drawings of the sa…