← Search

Guillem Cucurull

5 accepted papers

2024

Nougat: Neural Optical Understanding for Academic Documents

ICLR 2024poster

Scientific knowledge is predominantly stored in books and scientific journals, often in the form of PDFs. However, the PDF format leads to a loss of semantic information, particularly for mathematical expressions. We propose Nougat (Neural Optical Understanding for Academic Documents), a Visual Tran…

2018

Attend and Rectify: a gated attention mechanism for fine-grained recovery

ECCV 2018poster

We propose a novel attention mechanism to enhance Convolutional Neural Networks for fine-grained recognition. It learns to attend to lower-level feature activations without requiring part annotations and uses these activations to update and rectify the output likelihood distribution. In contrast to…

2018

Graph Attention Networks

ICLR 2018poster

We present graph attention networks (GATs), novel neural network architectures that operate on graph-structured data, leveraging masked self-attentional layers to address the shortcomings of prior methods based on graph convolutions or their approximations. By stacking layers in which nodes are able…

2017

Regularizing CNNs with Locally Constrained Decorrelations

ICLR 2017poster

Regularization is key for deep learning since it allows training more complex models while keeping lower levels of overfitting. However, the most prevalent regularizations do not leverage all the capacity of the models since they rely on reducing the effective number of parameters. Feature decorrela…

Cited by 163SourceScholar