Rohit Kumar Salla

CrossQ: Task-Aligned Cross-Token Conditional Quantization for Late Interaction Retrieval

Late-interaction retrievers like ColBERT achieve high quality but suffer from large multi-vector indices. Standard compression minimizes token reconstruction error, while ranking depends critically on preserving scores of sparse "winner" tokens. We introduce CrossQ which adaptively allocates precisi…