基于ReRAM的存内处理CNN加速器的经验性故障脆弱性探索
An Empirical Fault Vulnerability Exploration of ReRAM-based Process-in-Memory CNN Accelerators
Aniseh Dorostkar · Hamed Farbeh · Hamid R. Zarandi
中文摘要
基于阻变随机存取存储器(ReRAM)的存内处理(PIM)加速器凭借其模拟计算能力、超高密度、近乎零的漏电流以及非易失性,成为在并行域中处理神经网络海量访存密集型矩阵-向量乘法的有前景的平台。尽管具有诸多优势,基于ReRAM的加速器由于工艺制造限制导致的工艺偏差与缺陷而极易出错,这些限制会降低在PIM加速器上运行的深度卷积神经网络(Deep CNN)的精度。这类CNN加速器广泛部署于安全关键系统中,但其故障脆弱性尚未得到充分研究。本研究开发了一个故障注入框架,用于在推理阶段的软件层和硬件层两个层面探索大规模CNN的脆弱性。故障型ReRAM器件带来另一项可靠性挑战:当CNN参数被映射到加速器上时,分类精度会显著下降。为研究该挑战,将CNN学习参数映射到ReRAM交叉阵列,并向交叉阵列注入故障。所提框架分析了固定1(SaH)与固定0(SaL)故障模型对CNN学习参数不同层与不同位置的影响。通过大量故障注入,结果表明基于ReRAM的CNN PIM加速器的脆弱性行为极大地受到层的类型与深度、学习参数在每层中的位置、以及故障的取值与类型的影响。观察显示,不同模型对故障具有不同的脆弱性,具体而言,SaL相较SaH会进一步降低分类精度。
关键要点
- 01基于ReRAM的PIM加速器在工艺偏差和缺陷下易出错,会显著降低深度CNN推理精度
- 02构建软硬件协同的故障注入框架,在推理阶段对大规模CNN注入SaH与SaL两类故障
- 03脆弱性行为显著依赖于层的类型与深度、参数在层内的位置以及故障取值与类型
- 04不同CNN模型对故障的脆弱性表现各异
- 05SaL故障相比SaH故障对分类精度造成更严重的下降
解读
尚无解读。
原始英文摘要
arXiv:2610.07029v1 Announce Type: cross Abstract: Resistive random-access memory (ReRAM)-based Processing-in-Memory (PIM) accelerator is a promising platform for processing massively memory intensive matrix-vector multiplications of neural networks in parallel domain, due to its capability of analog computation, ultra-high density, near-zero leakage current, and non-volatility. Despite many advantages, ReRAM-based accelerators are highly error-prone due to limitations of technology fabrication that lead to process variations and defects. These limitations degrade the accuracy of Deep Convolutional Neural Networks (Deep CNNs) running on PIM accelerators. While these CNNs accelerators are widely deployed in safety-critical systems, their vulnerability to fault is not well explored. In this paper, we have developed a fault injection framework to investigate the vulnerability of large-scale CNNs at both software- and hardware-level of inference phases. Faulty ReRAM devices are another reliability challenges due to significant degradation of classification accuracy when CNN parameters are mapped to the accelerators. To investigate this challenge, we map the CNN learning parameter to the ReRAM crossbar and inject faults into crossbar arrays. The proposed framework analyzes the impact of stuck-at high (SaH) and stuck-at low (SaL) fault models on different layers and locations of CNN learning parameters. By performing extensive fault injections, we illustrate that the vulnerability behavior of ReRAM-based PIM accelerator for CNNs is greatly impressible to the types and depth of layers, the location of the learning parameter in every layer, and the value and types of faults. Our observations show that different models have different vulnerabilities to faults. Specifically, we show that SaL further reduces classification accuracy than SaH.
同方向论文 · cs.AR
查看全部 →面向 Verilog 生成的搜索引导推理轨迹整理
2610.37706FIGFLEX:面向低位宽 LLM 量化协同设计的混合精度 FP-INT GEMM 加速器
2610.30480VHDLBench:面向 VHDL 芯片设计的大语言模型评测与微调
2610.286763D-MoE:面向 3D 堆叠近存处理器的 MoE 解码互补性引导软硬件协同设计
2610.26991qGAMMA:面向多精度加速器的最优 DNN 映射框架
2610.23222内存带宽而非 FLOPs:边缘 GPU 上基于查询的分割解码器剖析与加速
2610.22377