Align, Write, Re-Order: Explainable End-to-End Speech Translation via Operation Sequence Generation
The black-box nature of end-to-end speech-to-text translation (E2E ST) makes it difficult to understand how source language inputs are being mapped to the target language. To solve this problem, we propose to simultaneously generate automatic speech recognition (ASR) and ST predictions such that eac…