Inioluwa Raji

Position: Mechanisms for Aggregated Individual Reporting Should be Established for Post-Deployment Evaluation

The need for developing model evaluations beyond static benchmarking, especially in the post-deployment phase, is now well-understood. At the same time, concerns about the concentration of power in deployed AI systems have sparked a keen interest in "democratic" or "public" AI. In this work, we brin…