Iain Mackie

DyVo: Dynamic Vocabularies for Learned Sparse Retrieval with Entities

Learned Sparse Retrieval (LSR) models use vocabularies from pre-trained transformers, which often split entities into nonsensical fragments. Splitting entities diminishes retrieval accuracy and limits the model’s ability to incorporate up-to-date world knowledge not included in the training data. In…