← Search

Leon Derczynski

7 accepted papers

2023

Anchoring Fine-tuning of Sentence Transformer with Semantic Label Information for Efficient Truly Few-shot Classification

EMNLP 2023short main

Few-shot classification is a powerful technique, but training requires substantial computing power and data. We propose an efficient method with small model sizes and less training data with only 2-8 training instances per class. Our proposed method, AncSetFit, targets low data scenarios by anchorin…

Cited by 0SourceScholar
2023

RWKV: Reinventing RNNs for the Transformer Era

EMNLP 2023long findings

Transformers have revolutionized almost all natural language processing (NLP) tasks but suffer from memory and computational complexity that scales quadratically with sequence length. In contrast, recurrent neural networks (RNNs) exhibit linear scaling in memory and computational requirements but st…

Cited by 0SourceScholar
2023

The Catalog Problem: Clustering and Ordering Variable-Sized Sets

ICML 2023poster

Prediction of a $\textbf{varying number}$ of $\textbf{ordered clusters}$ from sets of $\textbf{any cardinality}$ is a challenging task for neural networks, combining elements of set representation, clustering and learning to order. This task arises in many diverse areas, ranging from medical triage…

Cited by 1SourcePDFScholar
2022

Handling and Presenting Harmful Text in NLP Research

EMNLP 2022finding

Text data can pose a risk of harm. However, the risks are not fully understood, and how to handle, present, and discuss harmful text in a safe way remains an unresolved issue in the NLP community. We provide an analytical framework categorising harms on three axes: (1) the harm type (e.g., misinform…

Cited by 46SourcePDFScholar
2022

Set Interdependence Transformer: Set-to-Sequence Neural Networks for Permutation Learning and Structure Prediction

IJCAI 2022poster

The task of learning to map an input set onto a permuted sequence of its elements is challenging for neural networks. Set-to-sequence problems occur in natural language processing, computer vision and structure prediction, where interactions between elements of large sets define the optimal output.…

Cited by 2SourcePDFScholar
2021

PROCAT: Product Catalogue Dataset for Implicit Clustering, Permutation Learning and Structure Prediction

NeurIPS 2021poster

In this dataset paper we introduce PROCAT, a novel e-commerce dataset containing expertly designed product catalogues consisting of individual product offers grouped into complementary sections. We aim to address the scarcity of existing datasets in the area of set-to-sequence machine learning tasks…

Cited by 1SourceScholar