← Search

Iuliia Thorbecke

3 accepted papers

2025

XLSR-Transducer: Streaming ASR for Self-Supervised Pretrained Models

ICASSP 2025accepted

Self-supervised pretrained models exhibit competitive performance in automatic speech recognition (ASR) on finetuning, even with limited in-domain supervised data. However, popular pretrained models are not suitable for streaming ASR because they are trained with full attention context. In this pape…

Cited by 0SourceScholar
2024

Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper

EMNLP 2024finding

The training of automatic speech recognition (ASR) with little to no supervised data remains an open question. In this work, we demonstrate that streaming Transformer-Transducer (TT) models can be trained from scratch in consumer and accessible GPUs in their entirety with pseudo-labeled (PL) speech…

2024

TokenVerse: Towards Unifying Speech and NLP Tasks via Transducer-based ASR

EMNLP 2024main

In traditional conversational intelligence from speech, a cascaded pipeline is used, involving tasks such as voice activity detection, diarization, transcription, and subsequent processing with different NLP models for tasks like semantic endpointing and named entity recognition (NER). Our paper int…