← Search

Seyeon Lee

4 accepted papers

2021

Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning

ACL 2021long

Commonsense reasoning research has so far been limited to English. We aim to evaluate and improve popular multilingual language models (ML-LMs) to help advance commonsense reasoning (CSR) beyond English. We collect the Mickey corpus, consisting of 561k sentences in 11 different languages, which can…

2021

Pre-training Text-to-Text Transformers for Concept-centric Common Sense

ICLR 2021poster

Pretrained language models (PTLM) have achieved impressive results in a range of natural language understanding (NLU) and generation (NLG) tasks that require a syntactic and semantic understanding of the text. However, current pre-training objectives such as masked token prediction (for BERT-style P…

2021

RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms

EMNLP 2021main

Pre-trained language models (PTLMs) have achieved impressive performance on commonsense inference benchmarks, but their ability to employ commonsense to make robust inferences, which is crucial for effective communications with humans, is debated. In the pursuit of advancing fluid human-AI communica…