← Search

Ivan Provilkov

3 accepted papers

2021

Multi-Sentence Resampling: A Simple Approach to Alleviate Dataset Length Bias and Beam-Search Degradation

EMNLP 2021main

Neural Machine Translation (NMT) is known to suffer from a beam-search problem: after a certain point, increasing beam size causes an overall drop in translation quality. This effect is especially pronounced for long sentences. While much work was done analyzing this phenomenon, primarily for autore…

2021

Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Tasks

NeurIPS 2021poster

There has been significant research done on developing methods for improving robustness to distributional shift and uncertainty estimation. In contrast, only limited work has examined developing standard datasets and benchmarks for assessing these approaches. Additionally, most work on uncertainty e…

Cited by 160SourcecodeScholar