← Search

Steve Yadlowsky

7 accepted papers

2022

The MultiBERTs: BERT Reproductions for Robustness Analysis

ICLR 2022spotlight

Experiments with pre-trained models such as BERT are often based on a single checkpoint. While the conclusions drawn apply to the artifact tested in the experiment (i.e., the particular instance of the model), it is not always clear whether they hold for the more general procedure which includes the…

2021

Counterfactual Invariance to Spurious Correlations in Text Classification

NeurIPS 2021spotlight

Informally, a 'spurious correlation' is the dependence of a model on some aspect of the input data that an analyst thinks shouldn't matter. In machine learning, these have a know-it-when-you-see-it character; e.g., changing the gender of a sentence's subject changes a sentiment predictor's output. T…

Cited by 90SourcePDFScholar
2021

SLOE: A Faster Method for Statistical Inference in High-Dimensional Logistic Regression

NeurIPS 2021spotlight

Logistic regression remains one of the most widely used tools in applied statistics, machine learning and data science. However, in moderately high-dimensional problems, where the number of features $d$ is a non-negligible fraction of the sample size $n$, the logistic regression maximum likelihood e…

2020

Off-policy Policy Evaluation For Sequential Decisions Under Unobserved Confounding

NeurIPS 2020poster

When observed decisions depend only on observed features, off-policy policy evaluation (OPE) methods for sequential decision problems can estimate the performance of evaluation policies before deploying them. However, this assumption is frequently violated due to unobserved confounders, unrecorded v…

2017

Adaptive Sampling Probabilities for Non-Smooth Optimization

ICML 2017poster

Standard forms of coordinate and stochastic gradient methods do not adapt to structure in data; their good behavior under random sampling is predicated on uniformity in data. When gradients in certain blocks of features (for coordinate descent) or examples (for SGD) are larger than others, there is…

Cited by 48SourcePDFScholar