跳到正文
返回论文列表
cs.GR提交于 已译

ResStreamGS:面向移动体积视频流传输的残差敏感双流高斯泼溅

ResStreamGS: Residual-Sensitive Dual-Stream Gaussian Splatting for Mobile Volumetric Video Streaming

Haoran Liu · Di Wu · Wang Luo · Hengyuan Na · Miao Hu · Guocong Quan

中文摘要

实时移动体积视频虽能带来沉浸式自由视点体验,但在带宽与算力受限下传输高质量3D内容仍具挑战。现有基于3D高斯泼溅(3DGS)的系统(如V$^3$)利用通用视频编码器处理时变高斯属性,但将全场景所有高斯视为帧间变化信号,导致在时间稳定区域出现质量退化。ResStreamGS提出残差敏感双流框架,通过轻量级探针适应识别残差敏感基元,并在图像组(GOP)内复用稳定高斯。稳定高斯每GOP仅传输一次,仅残差敏感高斯保留在帧级硬件解码视频流中。在复杂全场景体积视频实验显示,相比V$^3$风格全高斯基线,ResStreamGS编码后PSNR提升7.51--8.35 dB,摊销载荷减少高达56.5%,并在Qualcomm Snapdragon 778G平台上实现30.883 FPS。

关键要点

  1. 01现有3DGS移动流传输将全场景高斯视为时变信号,导致时间稳定区域质量退化。
  2. 02提出ResStreamGS双流框架,通过轻量级探针识别残差敏感基元并复用稳定高斯。
  3. 03稳定高斯每GOP仅传输一次,仅残差敏感高斯保留在帧级硬件解码视频流中。
  4. 04复杂全场景实验中,编码后PSNR提升7.51--8.35 dB,摊销载荷减少高达56.5%。
  5. 05在Qualcomm Snapdragon 778G平台上实现30.883 FPS的实时渲染性能。

解读

尚无解读。

原始英文摘要

arXiv:2610.21121v1 Announce Type: cross Abstract: Real-time mobile volumetric video enables immersive free-viewpoint experiences, but delivering high-quality 3D content under constrained bandwidth and computation remains challenging. Recent 3D Gaussian Splatting (3DGS) systems, such as V$^3$, enable efficient mobile streaming by encoding time-varying Gaussian attributes with commodity video codecs and hardware decoding. However, existing pipelines treat all Gaussians as frame-varying signals, which is poorly suited to full-scene content where large portions remain temporally stable. Our empirical study shows that frame-wise adaptation and video coding of all Gaussians cause quality degradation in complex full-scene content, particularly in temporally stable regions. To address this issue, we propose ResStreamGS, a residual-sensitive dual-stream framework that processes Gaussians according to their temporal behavior. ResStreamGS identifies residual-sensitive primitives through lightweight probe adaptation and reuses stable Gaussians within each Group of Pictures (GOP). Stable Gaussians are transmitted once per GOP, while only residual-sensitive Gaussians remain in the frame-wise hardware-decodable video stream. Experiments on complex full-scene volumetric videos show that ResStreamGS improves post-codec PSNR by 7.51--8.35~dB over a controlled V$^3$-style all-Gaussians baseline, reduces amortized payload by up to 56.5%, and achieves 30.883~FPS on a Qualcomm Snapdragon 778G platform.

同方向论文 · cs.GR

查看全部 →