← Search

Koulik Khamaru

6 accepted papers

2023

Statistical Limits of Adaptive Linear Models: Low-Dimensional Estimation and Inference

NeurIPS 2023poster

Estimation and inference in statistics pose significant challenges when data are collected adaptively. Even in linear models, the Ordinary Least Squares (OLS) estimator may fail to exhibit asymptotic normality for single coordinate estimation and have inflated error. This issue is highlighted by a r…

2020

Sharp Analysis of Expectation-Maximization for Weakly Identifiable Models

AISTATS 2020poster

We study a class of weakly identifiable location-scale mixture models for which the maximum likelihood estimates based on $n$ i.i.d. samples are known to have lower accuracy than the classical $n^{- \frac{1}{2}}$ error. We investigate whether the Expectation-Maximization (EM) algorithm also converge…

Cited by 33SourcePDFScholar
2019

Derivative-Free Methods for Policy Optimization: Guarantees for Linear Quadratic Systems

AISTATS 2019poster

We study derivative-free methods for policy optimization over the class of linear policies. We focus on characterizing the convergence rate of a canonical stochastic, two-point, derivative-free method for linear-quadratic systems in which the initial state of the system is drawn at random. In partic…

Cited by 243SourcePDFScholar
2018

Convergence guarantees for a class of non-convex and non-smooth optimization problems

ICML 2018oral

Non-convex optimization problems arise frequently in machine learning, including feature selection, structured matrix learning, mixture modeling, and neural network training. We consider the problem of finding critical points of a broad class of non-convex problems with non-smooth components. We ana…

Cited by 59SourcePDFScholar
2018

Theoretical guarantees for EM under misspecified Gaussian mixture models

NeurIPS 2018poster

Recent years have witnessed substantial progress in understanding the behavior of EM for mixture models that are correctly specified. Given that model misspecification is common in practice, it is important to understand EM in this more general setting. We provide non-asymptotic guarantees…

Cited by 19SourcePDFScholar