跳到正文
返回论文列表
stat.ME提交于 已译

通用机器学习子组识别的统计性能保证

Statistical Performance Guarantee for Subgroup Identification with Generic Machine Learning

Michael Lingzhi Li · Kosuke Imai

中文摘要

在许多学科中,研究者使用机器学习(ML)算法来识别最可能从治疗中获益(“异常响应者”)或受损的子组。子组识别的常见方法分两步:首先用ML算法估计条件平均处理效应(CATE),然后根据估计的CATE选择预测受治疗影响最大(正向或负向)的个体。然而,CATE估计常有偏且噪声大,且用同一数据同时识别子组和估计其组平均处理效应会导致多重检验问题。为此,我们为按通用ML算法排序的组平均处理效应(GATES)估计开发了一致置信带。利用这些一致置信带,研究者可以在统计保证下识别出GATES超过某一效应大小的子组,无论该效应大小如何选择。该方法使用随机处理分配、单元随机抽样以及连续性和矩条件,不要求ML得分的一致性(consistency)或单调性。我们推导了估计误差的Wiener表示,并对经验子组阈值和固定处理样本量进行了校正。通过高斯抽样估计该表示,无需重新拟合ML模型即可获得渐近精确的一致覆盖。我们还为均值调整处理效应和其他评估指标开发了一致带。一个模拟设计和一个晚期前列腺癌临床试验的应用说明了子组识别问题。

关键要点

  1. 01问题:CATE估计有偏且噪声大,且用同一数据识别子组和估计效应导致多重检验问题。
  2. 02方法:为GATES开发一致置信带,使用随机分配、随机抽样和连续性条件,不要求ML得分一致或单调。
  3. 03结果:推导估计误差的Wiener表示并校正阈值和样本量,通过高斯抽样获得渐近精确一致覆盖,无需重新拟合ML模型。
  4. 04扩展:为均值调整处理效应和其他评估指标开发一致带。
  5. 05验证:模拟设计和晚期前列腺癌临床试验应用说明子组识别问题。

解读

尚无解读。

原始英文摘要

arXiv:2310.07973v4 Announce Type: replace-cross Abstract: Across a wide array of disciplines, many researchers use machine learning (ML) algorithms to identify a subgroup of individuals who are likely to benefit from a treatment the most (``exceptional responders'') or those who are harmed by it. A common approach to this subgroup identification problem consists of two steps. First, researchers estimate the conditional average treatment effect (CATE) using an ML algorithm. Next, they use the estimated CATE to select those individuals who are predicted to be most affected by the treatment, either positively or negatively. Unfortunately, CATE estimates are often biased and noisy. In addition, utilizing the same data to both identify a subgroup and estimate its group average treatment effect results in a multiple testing problem. To address these challenges, we develop uniform confidence bands for estimation of the group average treatment effect sorted by generic ML algorithm (GATES). Using these uniform confidence bands, researchers can identify, with a statistical guarantee, a subgroup whose GATES exceeds a certain effect size, regardless of how this effect size is chosen. The proposed methodology uses random treatment assignment, random sampling of units, and continuity and moment conditions, without requiring consistency or monotonicity of the ML score. We derive a Wiener representation of the estimation error, with corrections for the empirical subgroup threshold and the fixed treatment sample size. Estimating this representation gives asymptotically exact uniform coverage using Gaussian draws, without refitting the ML model. We also develop uniform bands for mean-adjusted treatment effects and other evaluation metrics. A simulation design and an application to a clinical trial of late-stage prostate cancer illustrate the subgroup identification problem.

同方向论文 · stat.ME

查看全部 →