Nameer Hirschkind

REINA: Regularized Entropy Information-Based Loss for Efficient Simultaneous Speech Translation

Simultaneous Speech Translation (SimulST) systems stream in audio while simultaneously emitting translated text or speech. Such systems face the significant challenge of balancing translation quality and latency. We introduce a strategy to optimize this tradeoff: wait for more input only if you gain