Maude Lizaire — accepted AI-conference papers

2024

A Tensor Decomposition Perspective on Second-order RNNs

Maude Lizaire, Michael Rizvi-Martel, Marawan Gamal, Guillaume Rabusseau

ICML 2024spotlight

Second-order Recurrent Neural Networks (2RNNs) extend RNNs by leveraging second-order interactions for sequence modelling. These models are provably more expressive than their first-order counterparts and have connections to well-studied models from formal language theory. However, their large param…

Cited by 0 Source ↗PDF ↗code ↗Scholar ↗

2024

Simulating weighted automata over sequences and trees with transformers

Michael Rizvi-Martel, Maude Lizaire, Clara Lacroce, Guillaume Rabusseau

AISTATS 2024poster

Transformers are ubiquitous models in the natural language processing (NLP) community and have shown impressive empirical successes in the past few years. However, little is understood about how they reason and the limits of their computational capabilities. These models do not process data sequenti…

Cited by 0 Source ↗PDF ↗Scholar ↗