← Search

Ziqiang Zhang

3 accepted papers

2024

Spatial-Contextual Discrepancy Information Compensation for GAN Inversion

AAAI 2024technical

Most existing GAN inversion methods either achieve accurate reconstruction but lack editability or offer strong editability at the cost of fidelity. Hence, how to balance the distortion-editability trade-off is a significant challenge for GAN inversion. To address this challenge, we introduce a nov…

2023

Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation

ICASSP 2023accepted

Direct speech-to-speech translation (S2ST) is an attractive research topic with many advantages compared to cascaded S2ST. However, direct S2ST suffers from the data scarcity problem because the corpora from the speech of the source language to the speech of the target language are very rare. To add…

Cited by 0SourceScholar
2022

SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training

EMNLP 2022main

The rapid development of single-modal pre-training has prompted researchers to pay more attention to cross-modal pre-training methods. In this paper, we propose a unified-modal speech-unit-text pre-training model, SpeechUT, to connect the representations of a speech encoder and a text decoder with a…