← Search

Pavel Denisov

5 accepted papers

2024

Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Study

ICASSP 2024accepted

Speech signals, typically sampled at rates in the tens of thousands per second, contain redundancies, evoking inefficiencies in sequence modeling. High-dimensional speech features such as spectrograms are often used as the input for the subsequent model. However, they can still be redundant. Recent…

Cited by 0SourceScholar
2024

Teaching a Multilingual Large Language Model to Understand Multilingual Speech via Multi-Instructional Training

NAACL 2024findings

Recent advancements in language modeling have led to the emergenceof Large Language Models (LLMs) capable ofvarious natural language processing tasks.Despite their success in text-based tasks, applying LLMs to the speech domainremains limited and challenging. This paper presents BLOOMZMMS, a novel m…

2023

Prosody Is Not Identity: A Speaker Anonymization Approach Using Prosody Cloning

ICASSP 2023accepted

Prosody is closely linked to the identity of a speaker, leading to individual pitch and intonation patterns. Therefore, it is challenging in speaker anonymization to generate speech utterances that both keep the original audio’s main prosodic structure and preserve the speaker’s privacy. In this pap…

Cited by 0SourceScholar
2022

ESPnet-SLU: Advancing Spoken Language Understanding Through ESPnet

ICASSP 2022accepted

As Automatic Speech Processing (ASR) systems are getting better, there is an increasing interest of using the ASR output to do downstream Natural Language Processing (NLP) tasks. However, there are few open source toolkits that can be used to generate reproducible results on different Spoken Languag…

Cited by 0SourceScholar
2019

Context-aware Neural-based Dialog Act Classification on Automatically Generated Transcriptions

ICASSP 2019accepted

This paper presents our latest investigations on dialog act (DA) classification on automatically generated transcriptions. We propose a novel approach that combines convolutional neural networks (CNNs) and conditional random fields (CRFs) for context modeling in DA classification. We explore the imp…

Cited by 0SourceScholar