← Search

Atsushi Keyaki

2 accepted papers

2024

Coarse-Tuning for Ad-hoc Document Retrieval Using Pre-trained Language Models

COLING 2024main

Fine-tuning in information retrieval systems using pre-trained language models (PLM-based IR) requires learning query representations and query-document relations, in addition to downstream task-specific learning. This study introduces coarse-tuning as an intermediate learning stage that bridges pre…

2022

Word-level Perturbation Considering Word Length and Compositional Subwords

ACL 2022findings

We present two simple modifications for word-level perturbation: Word Replacement considering Length (WR-L) and Compositional Word Replacement (CWR).In conventional word replacement, a word in an input is replaced with a word sampled from the entire vocabulary, regardless of the length and context o…