Ant{\'o}nio Farinhas

Translate Smart, not Hard: Cascaded Translation Systems with Quality-Aware Deferral

Larger models often outperform smaller ones but come with high computational costs. Cascading offers a potential solution. By default, it uses smaller models and defers only some instances to larger, more powerful models. However, designing effective deferral rules remains a challenge. In this paper