← Search

Yanis Labrak

6 accepted papers

2024

A Zero-shot and Few-shot Study of Instruction-Finetuned Large Language Models Applied to Clinical and Biomedical Tasks

COLING 2024main

The recent emergence of Large Language Models (LLMs) has enabled significant advances in the field of Natural Language Processing (NLP). While these new models have demonstrated superior performance on various tasks, their application and potential are still underexplored, both in terms of the diver…

Cited by 42SourcePDFScholar
2024

BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains

ACL 2024findings

Large Language Models (LLMs) have demonstrated remarkable versatility in recent years, offering potential applications across specialized domains such as healthcare and medicine. Despite the availability of various open-source LLMs tailored for health contexts, adapting general-purpose LLMs to the m…

2024

DrBenchmark: A Large Language Understanding Evaluation Benchmark for French Biomedical Domain

COLING 2024main

The biomedical domain has sparked a significant interest in the field of Natural Language Processing (NLP), which has seen substantial advancements with pre-trained language models (PLMs). However, comparing these models has proven challenging due to variations in evaluation protocols across differe…

2024

How Important Is Tokenization in French Medical Masked Language Models?

COLING 2024main

Subword tokenization has become the prevailing standard in the field of natural language processing (NLP) over recent years, primarily due to the widespread utilization of pre-trained language models. This shift began with Byte-Pair Encoding (BPE) and was later followed by the adoption of SentencePi…

2023

DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains

ACL 2023long

In recent years, pre-trained language models (PLMs) achieve the best performance on a wide range of natural language processing (NLP) tasks. While the first models were trained on general domain data, specialized ones have emerged to more effectively treat specific domains. In this paper, we propose…

Cited by 53SourcePDFScholar
2022

BigBio: A Framework for Data-Centric Biomedical Natural Language Processing

NeurIPS 2022accept

Training and evaluating language models increasingly requires the construction of meta-datasets -- diverse collections of curated data with clear provenance. Natural language prompting has recently lead to improved zero-shot generalization by transforming existing, supervised datasets into a variety…