Joey Öhman — accepted AI-conference papers

2024

GPT-SW3: An Autoregressive Language Model for the Scandinavian Languages

Ariel Ekgren, Amaru Cuba Gyllensten, Felix Stollenwerk, Joey Öhman, Tim Isbister, Evangelia Gogoulou +3

COLING 2024main

This paper details the process of developing the first native large generative language model for the North Germanic languages, GPT-SW3. We cover all parts of the development process, from data collection and processing, training configuration and instruction finetuning, to evaluation, applications,…

Cited by 4 Source ↗PDF ↗code ↗Scholar ↗

2023

Superlim: A Swedish Language Understanding Evaluation Benchmark

Aleksandrs Berdicevskis, Gerlof Bouma, Robin Kurtz, Felix Morger, Joey Öhman, Yvonne Adesam +12

EMNLP 2023long main

We present Superlim, a multi-task NLP benchmark and analysis platform for evaluating Swedish language models, a counterpart to the English-language (Super)GLUE suite. We describe the dataset, the tasks, the leaderboard and report the baseline results yielded by a reference implementation. The tested…

Cited by 0 Source ↗Scholar ↗

2022

Fine-Grained Controllable Text Generation Using Non-Residual Prompting

Fredrik Carlsson, Joey Öhman, Fangyu Liu, Severine Verlinden, Joakim Nivre, Magnus Sahlgren

ACL 2022long

The introduction of immensely large Causal Language Models (CLMs) has rejuvenated the interest in open-ended text generation. However, controlling the generative process for these Transformer-based models is at large an unsolved problem. Earlier work has explored either plug-and-play decoding strate…

Cited by 50 Source ↗PDF ↗code ↗Scholar ↗