← Search

Wenda Zhou

7 accepted papers

2020

Error bounds in estimating the out-of-sample prediction error using leave-one-out cross validation in high-dimensions

AISTATS 2020poster

We study the problem of out-of-sample risk estimation in the high dimensional regime where both the sample size $n$ and number of features $p$ are large, and $n/p$ can be less than one. Extensive empirical evidence confirms the accuracy of leave-one-out cross validation (LO) for out-of-sample risk e…

2019

Discrete Object Generation with Reversible Inductive Construction

NeurIPS 2019poster

The success of generative modeling in continuous domains has led to a surge of interest in generating discrete data such as molecules, source code, and graphs. However, construction histories for these discrete objects are typically not unique and so generative models must reason about intractably l…

2019

Empirical Risk Minimization and Stochastic Gradient Descent for Relational Data

AISTATS 2019poster

Empirical risk minimization is the main tool for prediction problems, but its extension to relational data remains unsolved. We solve this problem using recent ideas from graph sampling theory to (i) define an empirical risk for relational data and (ii) obtain stochastic gradients for this empirical…

2019

Non-vacuous Generalization Bounds at the ImageNet Scale: a PAC-Bayesian Compression Approach

ICLR 2019poster

Modern neural networks are highly overparameterized, with capacity to substantially overfit to training data. Nevertheless, these networks often generalize well in practice. It has also been observed that trained networks can often be ``compressed to much smaller representations. The purpose of this…

2018

Approximate Leave-One-Out for Fast Parameter Tuning in High Dimensions

ICML 2018oral

We study the parameter tuning problem for the penalized regression model. Finding the optimal choice of the regularization parameter is a challenging problem in high-dimensional regimes where both the number of observations n and the number of parameters p are large. We propose two frameworks to obt…