← Search

Tobias Schimanski

4 accepted papers

2025

DIRAS: Efficient LLM Annotation of Document Relevance for Retrieval Augmented Generation

NAACL 2025long

Retrieval Augmented Generation (RAG) is widely employed to ground responses to queries on domain-specific documents. But do RAG implementations leave out important information when answering queries that need an integrated analysis of information (e.g., Tell me good news in the stock market today.)?…

2024

ClimRetrieve: A Benchmarking Dataset for Information Retrieval from Corporate Climate Disclosures

EMNLP 2024main

To handle the vast amounts of qualitative data produced in corporate climate communication, stakeholders increasingly rely on Retrieval Augmented Generation (RAG) systems. However, a significant gap remains in evaluating domain-specific information retrieval – the basis for answer generation. To add…

2024

Towards Faithful and Robust LLM Specialists for Evidence-Based Question-Answering

ACL 2024long

Advances towards more faithful and traceable answers of Large Language Models (LLMs) are crucial for various research and practical endeavors. One avenue in reaching this goal is basing the answers on reliable sources. However, this Evidence-Based QA has proven to work insufficiently with LLMs in te…

2023

ClimateBERT-NetZero: Detecting and Assessing Net Zero and Reduction Targets

EMNLP 2023short main

Public and private actors struggle to assess the vast amounts of information about sustainability commitments made by various institutions. To address this problem, we create a novel tool for automatically detecting corporate and national net zero and reduction targets in three steps. First, we intr…

Cited by 0SourceScholar