← Search

Young-Suk Lee

8 accepted papers

2023

Ensemble-Instruct: Instruction Tuning Data Generation with a Heterogeneous Mixture of LMs

EMNLP 2023long findings

Using in-context learning (ICL) for data generation, techniques such as Self-Instruct (Wang et al., 2023) or the follow-up Alpaca (Taori et al., 2023) can train strong conversational agents with only a small amount of human supervision. One limitation of these approaches is that they resort to very…

Cited by 0SourceScholar
2022

DocAMR: Multi-Sentence AMR Representation and Evaluation

NAACL 2022long

Despite extensive research on parsing of English sentences into Abstract Meaning Representation (AMR) graphs, which are compared to gold graphs via the Smatch metric, full-document parsing into a unified graph representation lacks well-defined representation and evaluation. Taking advantage of a sup…

2022

Learning Cross-Lingual IR from an English Retriever

NAACL 2022long

We present DR.DECR (Dense Retrieval with Distillation-Enhanced Cross-Lingual Representation), a new cross-lingual information retrieval (CLIR) system trained using multi-stage knowledge distillation (KD). The teacher of DR.DECR relies on a highly effective but computationally expensive two-stage inf…

2022

Maximum Bayes Smatch Ensemble Distillation for AMR Parsing

NAACL 2022long

AMR parsing has experienced an unprecendented increase in performance in the last three years, due to a mixture of effects including architecture improvements and transfer learning. Self-learning techniques have also played a role in pushing performance forward. However, for most recent high perform…

2022

SYGMA: A System for Generalizable and Modular Question Answering Over Knowledge Bases

EMNLP 2022finding

Knowledge Base Question Answering (KBQA) involving complex reasoning is emerging as an important research direction. However, most KBQA systems struggle with generalizability, particularly on two dimensions: (a) across multiple knowledge bases, where existing KBQA approaches are typically tuned to a…

2021

A Semantics-aware Transformer Model of Relation Linking for Knowledge Base Question Answering

ACL 2021short

Relation linking is a crucial component of Knowledge Base Question Answering systems. Existing systems use a wide variety of heuristics, or ensembles of multiple systems, heavily relying on the surface question text. However, the explicit semantic parse of the question is a rich source of relation i…

Cited by 34SourcePDFScholar
2021

Ensembling Graph Predictions for AMR Parsing

NeurIPS 2021poster

In many machine learning tasks, models are trained to predict structure data such as graphs. For example, in natural language processing, it is very common to parse texts into dependency trees or abstract meaning representation (AMR) graphs. On the other hand, ensemble methods combine predictions fr…

2021

Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing

EMNLP 2021main

Predicting linearized Abstract Meaning Representation (AMR) graphs using pre-trained sequence-to-sequence Transformer models has recently led to large improvements on AMR parsing benchmarks. These parsers are simple and avoid explicit modeling of structure but lack desirable properties such as graph…