← Search

Gongbo Tang

3 accepted papers

2024

MTA4DPR: Multi-Teaching-Assistants Based Iterative Knowledge Distillation for Dense Passage Retrieval

EMNLP 2024main

Although Dense Passage Retrieval (DPR) models have achieved significantly enhanced performance, their widespread application is still hindered by the demanding inference efficiency and high deployment costs. Knowledge distillation is an efficient method to compress models, which transfers knowledge…

Cited by 1SourcePDFScholar
2020

Understanding Pure Character-Based Neural Machine Translation: The Case of Translating Finnish into English

COLING 2020main

Recent work has shown that deeper character-based neural machine translation (NMT) models can outperform subword-based models. However, it is still unclear what makes deeper character-based models successful. In this paper, we conduct an investigation into pure character-based models in the case of…

Cited by 9SourcePDFScholar