Andrew Kwong

Bit-Flip Error Resilience in LLMs: A Comprehensive Analysis and Defense Framework

Bit-flip errors (BFEs) are hardware faults where individual bits in memory or processing units are unintentionally flipped. These errors pose a significant threat to neural network reliability because even small changes in model parameters can lead to large shifts in outputs. Large language models (