← Search

Luheng He

5 accepted papers

2022

TableFormer: Robust Transformer Modeling for Table-Text Encoding

ACL 2022long

Understanding tables is an important aspect of natural language understanding. Existing models for table understanding require linearization of the table structure, where row or column order is encoded as an unwanted bias. Such spurious biases make the model vulnerable to row and column order pertur…

2021

Few-shot Intent Classification and Slot Filling with Retrieved Examples

NAACL 2021long

Few-shot learning arises in important practical scenarios, such as when a natural language understanding system needs to learn new semantic labels for an emerging, resource-scarce domain. In this paper, we explore retrieval-based methods for intent classification and slot filling tasks in few-shot s…

Cited by 60SourcePDFScholar
2021

Graph-Based Decoding for Task Oriented Semantic Parsing

EMNLP 2021finding

The dominant paradigm for semantic parsing in recent years is to formulate parsing as a sequence-to-sequence task, generating predictions with auto-regressive sequence decoders. In this work, we explore an alternative paradigm. We formulate semantic parsing as a dependency parsing task, applying gra…

2021

QA-Driven Zero-shot Slot Filling with Weak Supervision Pretraining

ACL 2021short

Slot-filling is an essential component for building task-oriented dialog systems. In this work, we focus on the zero-shot slot-filling problem, where the model needs to predict slots and their values, given utterances from new domains without training on the target domain. Prior methods directly enc…

2021

TIMEDIAL: Temporal Commonsense Reasoning in Dialog

ACL 2021long

Everyday conversations require understanding everyday events, which in turn, requires understanding temporal commonsense concepts interwoven with those events. Despite recent progress with massive pre-trained language models (LMs) such as T5 and GPT-3, their capability of temporal reasoning in dialo…