← Search

Luca Scimeca

10 accepted papers

2026

At the Edge of Understanding: Sparse Autoencoders Trace The Limits of Transformer Generalization

ICML 2026poster

Pre-trained transformers have demonstrated remarkable generalization abilities, at times extending beyond the scope of their training data. Yet, real-world deployments often face unexpected or adversarial data that diverges from training data distributions. Without explicit mechanisms for handling s…

Cited by 0SourceScholar
2025

From Noise to Narrative: Tracing the Origins of Hallucinations in Transformers

NeurIPS 2025poster

As generative AI systems become competent and democratized in science, business, and government, deeper insight into their failure modes now poses an acute need. The occasional volatility in their behavior, such as the propensity of transformer models to hallucinate, impedes trust and adoption of em…

Cited by 0SourceScholar
2025

Outsourced Diffusion Sampling: Efficient Posterior Inference in Latent Spaces of Generative Models

ICML 2025poster

Any well-behaved generative model over a variable $\mathbf{x}$ can be expressed as a deterministic transformation of an exogenous (‘*outsourced'*) Gaussian noise variable $\mathbf{z}$: $\mathbf{x}=f_\theta(\mathbf{z})$. In such a model (*eg*, a VAE, GAN, or continuous-time flow-based model), sampli…

Cited by 0SourcePDFScholar
2024

Amortizing intractable inference in diffusion models for vision, language, and control

NeurIPS 2024poster

Diffusion models have emerged as effective distribution estimators in vision, language, and reinforcement learning, but their use as priors in downstream tasks poses an intractable posterior inference problem. This paper studies *amortized* sampling of the posterior over data, $\mathbf{x}\sim p^{\rm…

2024

Improved off-policy training of diffusion samplers

NeurIPS 2024poster

We study the problem of training diffusion models to sample from a distribution with a given unnormalized density or energy function. We benchmark several diffusion-structured inference methods, including simulation-based variational approaches and off-policy methods (continuous generative flow netw…

2022

Which Shortcut Cues Will DNNs Choose? A Study from the Parameter-Space Perspective

ICLR 2022poster

Deep neural networks (DNNs) often rely on easy–to–learn discriminatory features, or cues, that are not necessarily essential to the problem at hand. For example, ducks in an image may be recognized based on their typical background scenery, such as lakes or streams. This phenomenon, also known as sh…

Cited by 60SourcePDFScholar
2021

Neural Hybrid Automata: Learning Dynamics With Multiple Modes and Stochastic Transitions

NeurIPS 2021poster

Effective control and prediction of dynamical systems require appropriate handling of continuous-time and discrete, event-triggered processes. Stochastic hybrid systems (SHSs), common across engineering domains, provide a formalism for dynamical systems subject to discrete, possibly stochastic, stat…

Cited by 13SourcePDFScholar
2019

Model-Free Soft-Structure Reconstruction for Proprioception Using Tactile Arrays

RA-L 2019

Continuum body structures provide unique opportunities for soft robotics, with the infinite degrees of freedom enabling unconstrained and highly adaptive exploration and manipulation. However, the infinite degrees of freedom of continuum bodies makes sensing (both intrinsically and extrinsically) ch

Cited by 46SourceScholar
2019

Non-Destructive Robotic Assessment of Mango Ripeness via Multi-Point Soft Haptics

ICRA 2019poster

To match the ever increasing standards of fresh products, and the need to reduce waste, we devise an alternative to the destructive and highly variable fruit ripeness estimation by a penetrometer. We propose a fully automatic method to assess the ripeness of mango which is non-destructive, allows th…

Cited by 46SourceScholar