← Search

Juraj Vladika

7 accepted papers

2025

Facts Fade Fast: Evaluating Memorization of Outdated Medical Knowledge in Large Language Models

EMNLP 2025

The growing capabilities of Large Language Models (LLMs) can enhance healthcare by assisting medical researchers, physicians, and improving access to health services for patients. LLMs encode extensive knowledge within their parameters, including medical knowledge derived from many sources. However,

2025

On the Influence of Context Size and Model Choice in Retrieval-Augmented Generation Systems

NAACL 2025findings

Retrieval-augmented generation (RAG) has emerged as an approach to augment large language models (LLMs) by reducing their reliance on static knowledge and improving answer factuality. RAG retrieves relevant context snippets and generates an answer based on them. Despite its increasing industrial ado…

2025

Step-by-Step Fact Verification System for Medical Claims with Explainable Reasoning

NAACL 2025short

Fact verification (FV) aims to assess the veracity of a claim based on relevant evidence. The traditional approach for automated FV includes a three-part pipeline relying on short evidence snippets and encoder-only inference models. More recent approaches leverage the multi-turn nature of LLMs to ad…

2024

HealthFC: Verifying Health Claims with Evidence-Based Medical Fact-Checking

COLING 2024main

In the digital age, seeking health advice on the Internet has become a common practice. At the same time, determining the trustworthiness of online medical content is increasingly challenging. Fact-checking has emerged as an approach to assess the veracity of factual claims using evidence from credi…

2024

Improving Health Question Answering with Reliable and Time-Aware Evidence Retrieval

NAACL 2024findings

In today’s digital world, seeking answers to health questions on the Internet is a common practice. However, existing question answering (QA) systems often rely on using pre-selected and annotated evidence documents, thus making them inadequate for addressing novel questions. Our study focuses on th…

2024

MedREQAL: Examining Medical Knowledge Recall of Large Language Models via Question Answering

ACL 2024findings

In recent years, Large Language Models (LLMs) have demonstrated an impressive ability to encode knowledge during pre-training on large text corpora. They can leverage this knowledge for downstream tasks like question answering (QA), even in complex areas involving health topics. Considering their hi…