← Search

Clara Lacroce

2 accepted papers

2024

Length independent PAC-Bayes bounds for Simple RNNs

AISTATS 2024poster

While the practical interest of Recurrent neural networks (RNNs) is attested, much remains to be done to develop a thorough theoretical understanding of their abilities, particularly in what concerns their learning capacities. A powerful framework to tackle this question is the one of PAC-Bayes theo…

Cited by 4SourcePDFScholar
2024

Simulating weighted automata over sequences and trees with transformers

AISTATS 2024poster

Transformers are ubiquitous models in the natural language processing (NLP) community and have shown impressive empirical successes in the past few years. However, little is understood about how they reason and the limits of their computational capabilities. These models do not process data sequenti…

Cited by 0SourcePDFScholar