Andrea Gesmundo — accepted AI-conference papers

2020

Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function

Iulia M. Comsa, Thomas Fischbacher, Krzysztof Potempa, Andrea Gesmundo, Luca Versari, Jyrki Alakuijala

ICASSP 2020accepted

We propose a spiking neural network model that encodes information in the relative timing of individual neuron spikes and performs classification using the first output neuron to spike. This temporal coding scheme allows the supervised training of the network with backpropagation, using locally exac…

Cited by 0 Source ↗Scholar ↗

2019

Parameter-Efficient Transfer Learning for NLP

Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo +2

ICML 2019oral

Fine-tuning large pretrained models is an effective transfer mechanism in NLP. However, in the presence of many downstream tasks, fine-tuning is parameter inefficient: an entire new model is required for every task. As an alternative, we propose transfer with adapter modules. Adapter modules yield a…

Cited by 5271 Source ↗PDF ↗code ↗Scholar ↗

2018

Ask the Right Questions: Active Question Reformulation with Reinforcement Learning

Christian Buck, Jannis Bulian, Massimiliano Ciaramita, Wojciech Gajewski, Andrea Gesmundo, Neil Houlsby +1

ICLR 2018oral

We frame Question Answering (QA) as a Reinforcement Learning task, an approach that we call Active Question Answering. We propose an agent that sits between the user and a black box QA system and learns to reformulate questions to elicit the best possible answers. The agent probes the system with,…

Cited by 190 Source ↗PDF ↗Scholar ↗

2018

Transfer Learning with Neural AutoML

Catherine Wong, Neil Houlsby, Yifeng Lu, Andrea Gesmundo

NeurIPS 2018poster

We reduce the computational cost of Neural AutoML with transfer learning. AutoML relieves human effort by automating the design of ML algorithms. Neural AutoML has become popular for the design of deep learning architectures, however, this method has a high computation cost. To address this we propo…

Cited by 137 Source ↗PDF ↗Scholar ↗