Nicholas Comment

Iterative Stratified Testing and Measurement for Automated Model Updates

Automating updates to machine learning systems is an important but understudied challenge in AutoML. The high model variance of many cutting-edge deep learning architectures means that retraining a model provides no guarantee of accurate inference on all sample types. To address this concern, we pre…