Robin Nittka

Hierarchical Retrieval: The Geometry and a Pretrain-Finetune Recipe

Dual encoder (DE) models, where a pair of matching query and document are embedded into similar vector representations, are widely used in information retrieval due to their simplicity and scalability. However, the Euclidean geometry of the embedding space limits the expressive power of DEs, which m…