← Search

Sina Khoshfetrat Pakazad

2 accepted papers

2025

Better Instruction-Following Through Minimum Bayes Risk

ICLR 2025spotlight

General-purpose LLM judges capable of human-level evaluation provide not only a scalable and accurate way of evaluating instruction-following LLMs but also new avenues for supervising and improving their performance. One promising way of leveraging LLM judges for supervision is through Minimum Bayes…

Cited by 5Source ↗PDF ↗Scholar ↗
2024

Synthetic Multimodal Question Generation

EMNLP 2024finding

Multimodal Retrieval Augmented Generation (MMRAG) is a powerful approach to question-answering over multimodal documents. A key challenge with evaluating MMRAG is the paucity of high-quality datasets matching the question styles and modalities of interest. In light of this, we propose SMMQG, a synth…

Cited by 5Source ↗PDF ↗Scholar ↗