← Search

Soichiro Kumano

4 accepted papers

2026

Adversarially Pretrained Transformers may be Universally Robust In-Context Learners

ICLR 2026poster

Adversarial training is one of the most effective adversarial defenses, but it incurs a high computational cost. In this study, we present the first theoretical analysis suggesting that adversarially pretrained transformers can serve as universally robust foundation models, models that can robustly…

Cited by 0SourcecodeScholar
2024

Theoretical Understanding of Learning from Adversarial Perturbations

ICLR 2024poster

It is not fully understood why adversarial examples can deceive neural networks and transfer between different networks. To elucidate this, several studies have hypothesized that adversarial perturbations, while appearing as noises, contain class features. This is supported by empirical evidence sho…

2024

Wide Two-Layer Networks can Learn from Adversarial Perturbations

NeurIPS 2024poster

Adversarial examples have raised several open questions, such as why they can deceive classifiers and transfer between different models. A prevailing hypothesis to explain these phenomena suggests that adversarial perturbations appear as random noise but contain class-specific features. This hypothe…