← Search

Paul Bennett

6 accepted papers

2022

Zero-Shot Dense Retrieval with Momentum Adversarial Domain Invariant Representations

ACL 2022findings

Dense retrieval (DR) methods conduct text retrieval by first encoding texts in the embedding space and then matching them by nearest neighbor search. This requires strong locality properties from the representation space, e.g., close allocations of each small group of relevant texts, which are hard…

2021

Few-Shot Text Ranking with Meta Adapted Synthetic Weak Supervision

ACL 2021long

The effectiveness of Neural Information Retrieval (Neu-IR) often depends on a large scale of in-domain relevance training signals, which are not always available in real-world ranking scenarios. To democratize the benefits of Neu-IR, this paper presents MetaAdaptRank, a domain adaptive learning meth…

2021

Keep It Simple: Unsupervised Simplification of Multi-Paragraph Text

ACL 2021long

This work presents Keep it Simple (KiS), a new approach to unsupervised text simplification which learns to balance a reward across three properties: fluency, salience and simplicity. We train the model with a novel algorithm to optimize the reward (k-SCST), in which the model proposes several candi…

2021

Less is More: Pretrain a Strong Siamese Encoder for Dense Text Retrieval Using a Weak Decoder

EMNLP 2021main

Dense retrieval requires high-quality text sequence embeddings to support effective search in the representation space. Autoencoder-based language models are appealing in dense retrieval as they train the encoder to output high-quality embedding that can reconstruct the input texts. However, in this…

2021

Say ‘YES’ to Positivity: Detecting Toxic Language in Workplace Communications

EMNLP 2021finding

Workplace communication (e.g. email, chat, etc.) is a central part of enterprise productivity. Healthy conversations are crucial for creating an inclusive environment and maintaining harmony in an organization. Toxic communications at the workplace can negatively impact overall job satisfaction and…

Cited by 26SourcePDFScholar
2020

Transformer-XH: Multi-Evidence Reasoning with eXtra Hop Attention

ICLR 2020poster

Transformers have achieved new heights modeling natural language as a sequence of text tokens. However, in many real world scenarios, textual data inherently exhibits structures beyond a linear sequence such as trees and graphs; many tasks require reasoning with evidence scattered across multiple pi…

Cited by 132SourcecodeScholar