← Search

SATOSHI NOGUCHI

2 accepted papers

2025

Wavy Transformer

NeurIPS 2025poster

Transformers have achieved remarkable success across natural language processing (NLP) and computer vision (CV). However, deep transformer models often suffer from an over-smoothing issue, in which token representations converge to similar values as they pass through successive transformer blocks. I…

Cited by 0SourceScholar