Kuo Lin

Neural Retrieval for Question Answering with Cross-Attention Supervised Data Augmentation

Early fusion models with cross-attention have shown better-than-human performance on some question answer benchmarks, while it is a poor fit for retrieval since it prevents pre-computation of the answer representations. We present a supervised data mining method using an accurate early fusion model…