跳到正文
返回论文列表
cs.LG提交于 已译

随机分配下基于多尺度 FFT 的快速隐私损失核算

Fast Privacy Loss Accounting for Random Allocation via Multiscale FFT

Vitaly Feldman · Moshe Shenfeld

中文摘要

在随机分配采样方案中,每个用户的数据被用于从 t 步序列中随机均匀选出的 k 步。该方案在私有优化和通信高效聚合中优于泊松采样。现有针对该方案的隐私损失分布(PLD)核算器运行时间为精度参数 α 倒数的二次方(Feldman 和 Shenfeld,2026)。提出多尺度 FFT 算法,在每个二进区间内用均匀网格表示似然比,并在各区间内用 FFT 精确计算每对求和的舍入。它保持核算器的保证,并将运行时间对 α 的依赖从 O(α^{-2}) 改进到 O(α^{-1}log(1/α))。此外,舍入可通过 Doroshenko 等人(2026)的保均值连点投影完成,将舍入在隐私损失均值和计算对的 χ^2 散度中引入的误差从 α 量级降至 O(α^2/log(t))。实验中,算法在高精度下实现数个数量级加速,并为使用 PREAMBLE 的 DP-SGD 给出更优隐私界。

关键要点

  1. 01随机分配采样中现有 PLD 核算器运行时间为 O(α^{-2}),精度提高时开销大
  2. 02多尺度 FFT 在二进区间内用 FFT 精确舍入,时间降至 O(α^{-1}log(1/α))
  3. 03保均值连点投影将舍入误差从 α 量级降至 O(α^2/log(t))
  4. 04高精度实验实现数个数量级加速,并改进 DP-SGD with PREAMBLE 的隐私界

解读

尚无解读。

原始英文摘要

arXiv:2610.42117v1 Announce Type: new Abstract: In the random allocation sampling scheme each user's data is used in $k$ steps chosen randomly and uniformly from a sequence of $t$ steps. This scheme is known to improve on Poisson sampling in private optimization and in communication-efficient aggregation. The existing privacy loss distribution (PLD) accountant for this scheme runs in time quadratic in the inverse of the accuracy parameter $\alpha$ (Feldman and Shenfeld, 2026). We give an algorithm, \emph{multiscale FFT}, that represents likelihood ratios on a grid that is uniform within each dyadic interval and computes the exact rounding of every pairwise sum using FFTs within each interval. It keeps the guarantees of the accountant and improves the dependence of its running time on $\alpha$ from $O(\alpha^{-2})$ to $O(\alpha^{-1}\log(1/\alpha))$. In addition, we demonstrate that rounding can be performed via the mean-preserving connect-the-dots projection of (Doroshenko et al., 2026). This reduces the errors that rounding introduces in the mean of the privacy loss and in the $\chi^2$ divergence of the computed pair from the order of $\alpha$ to $O(\alpha^2/\log(t))$. In our experiments, our algorithm achieves speedups of several orders of magnitude at high accuracy and gives improved privacy bounds for DP-SGD with PREAMBLE.

同方向论文 · cs.LG

查看全部 →