← Search

Nico Pelleriti

4 accepted papers

2026

Neural Sum-of-Squares: Certifying the Nonnegativity of Polynomials with Transformers

ICLR 2026poster

Certifying nonnegativity of polynomials is a well-known NP-hard problem with direct applications spanning non-convex optimization, control, robotics, and beyond. A sufficient condition for nonnegativity is the Sum-of-Squares property, i.e., it can be written as a sum of squares of other polynomials.…

Cited by 0SourcecodeScholar
2026

When Does Sparsity Mitigate the Curse of Depth in LLMs

ICML 2026poster

Recent work has demonstrated the curse of depth in large language models (LLMs), where later layers contribute less to learning and representation than earlier layers. Such under-utilization is linked to the accumulated growth of variance in Pre-Layer Normalization, which can push deep blocks toward…

Cited by 0SourceScholar
2025

Approximating Latent Manifolds in Neural Networks via Vanishing Ideals

ICML 2025poster

Deep neural networks have reshaped modern machine learning by learning powerful latent representations that often align with the manifold hypothesis: high-dimensional data lie on lower-dimensional manifolds. In this paper, we establish a connection between manifold learning and computational algebra…

Cited by 0SourcePDFScholar
2025

Computational Algebra with Attention: Transformer Oracles for Border Basis Algorithms

NeurIPS 2025poster

Solving systems of polynomial equations, particularly those with finitely many solutions, is a crucial challenge across many scientific fields. Traditional methods like Gröbner and Border bases are fundamental but suffer from high computational costs, which have motivated recent Deep Learning approa…

Cited by 0SourcecodeScholar