2025
Batched Self-Consistency Improves LLM Relevance Assessment and Ranking
EMNLP 2025
LLM query-passage relevance assessment is typically studied using a one-by-one pointwise (PW) strategy where each LLM call judges one passage at a time. However, this strategy requires as many LLM calls as there are passages while also preventing information sharing between passages. We thus hypothe