← Search

Midia Yousefi

4 accepted papers

2024

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations

NeurIPS 2024poster

Recent advancements in zero-shot text-to-speech (TTS) modeling have led to significant strides in generating high-fidelity and diverse speech. However, dialogue generation, along with achieving human-like naturalness in speech, continues to be a challenge. In this paper, we introduce CoVoMix: Conver…

2024

Profile-Error-Tolerant Target-Speaker Voice Activity Detection

ICASSP 2024accepted

Target-Speaker Voice Activity Detection (TS-VAD) utilizes a set of speaker profiles alongside an input audio signal to perform speaker diarization. While its superiority over conventional methods has been demonstrated, the method can suffer from errors in speaker profiles, as those profiles are typi…

Cited by 0SourceScholar
2024

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation

NeurIPS 2024poster

There is a rising interest and trend in research towards directly translating speech from one language to another, known as end-to-end speech-to-speech translation. However, most end-to-end models struggle to outperform cascade models, i.e., a pipeline framework by concatenating speech recognition,…