← Search

Horia Mania

6 accepted papers

2020

Evaluating Machine Accuracy on ImageNet

ICML 2020poster

We evaluate a wide range of ImageNet models with five trained human labelers. In our year-long experiment, trained humans first annotated 40,000 images from the ImageNet and ImageNetV2 test sets with multi-class labels to enable a semantically coherent evaluation. Then we measured the classification…

Cited by 205SourcePDFScholar
2019

Model Similarity Mitigates Test Set Overuse

NeurIPS 2019poster

Excessive reuse of test data has become commonplace in today's machine learning workflows. Popular benchmarks, competitions, industrial scale tuning, among other applications, all involve test data reuse beyond guidance by statistical confidence bounds. Nonetheless, recent replication studies give e…

2018

Regret Bounds for Robust Adaptive Control of the Linear Quadratic Regulator

NeurIPS 2018poster

We consider adaptive control of the Linear Quadratic Regulator (LQR), where an unknown linear system is controlled subject to quadratic costs. Leveraging recent developments in the estimation of linear systems and in robust controller synthesis, we present the first provably polynomial time algorith…

Cited by 332SourcePDFScholar
2018

Simple random search of static linear policies is competitive for reinforcement learning

NeurIPS 2018poster

Model-free reinforcement learning aims to offer off-the-shelf solutions for controlling dynamical systems without requiring models of the system dynamics. We introduce a model-free random search algorithm for training static, linear policies for continuous control problems. Common evaluation method…

Cited by 331SourcePDFScholar