Kihyuk Yoon

LayerAct: Advanced Activation Mechanism for Robust Inference of CNNs

In this work, we propose a novel activation mechanism called LayerAct for CNNs. This approach is motivated by our theoretical and experimental analyses, which demonstrate that Layer Normalization (LN) can mitigate a limitation of existing activation functions regarding noise robustness. However, LN…