2020
Poly-encoders: Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring
ICLR 2020poster
The use of deep pre-trained transformers has led to remarkable progress in a number of applications (Devlin et al., 2018). For tasks that make pairwise comparisons between sequences, matching a given input with a corresponding label, two approaches are common: Cross-encoders performing full self-att…