Francis Kubala

A Unified Metric for Simultaneous Evaluation of Error Rate and Annotation Cost

Pattern classification systems have traditionally been trained using a set of labeled training data and subsequently evaluated using different testing data. The cost of labeling the training data is typically substantial. Online Human-In-The-Loop (HITL) algorithms present an alternate approach that…