← Search

Van-Hoan Trinh

3 accepted papers

2026

Functional Equivalence in Attention: A Comprehensive Study with Applications to Linear Mode Connectivity

ICML 2026poster

Neural network parameter spaces are inherently non-injective, as distinct parameter configurations can realize identical functions through functional equivalence. While this symmetry is well understood in classical fully connected and convolutional models, it becomes substantially more intricate in …

Cited by 0SourceScholar
2025

On Linear Mode Connectivity of Mixture-of-Experts Architectures

NeurIPS 2025oral

Linear Mode Connectivity (LMC) is a notable phenomenon in the loss landscapes of neural networks, wherein independently trained models have been observed to be connected—up to permutation symmetries—by linear paths in parameter space along which the loss remains consistently low. This observation ch…

Cited by 0SourceScholar
2024

Fourier Amplitude and Correlation Loss: Beyond Using L2 Loss for Skillful Precipitation Nowcasting

NeurIPS 2024poster

Deep learning approaches have been widely adopted for precipitation nowcasting in recent years. Previous studies mainly focus on proposing new model architectures to improve pixel-wise metrics. However, they frequently result in blurry predictions which provide limited utility to forecasting operati…