2024
Stratified Prediction-Powered Inference for Effective Hybrid Evaluation of Language Models
NeurIPS 2024poster
Prediction-powered inference (PPI) is a method that improves statistical estimates based on limited human-labeled data. PPI achieves this by combining small amounts of human-labeled data with larger amounts of data labeled by a reasonably accurate---but potentially biased---automatic system, in a w…