← Search

Tim Franzmeyer

11 accepted papers

2026

High Accuracy, Less Talk (HALT): Reliable LLMs through Capability-Aligned Finetuning

ICLR 2026poster

Large Language Models (LLMs) currently respond to every prompt. However, they can produce incorrect answers when they lack knowledge or capability -- a problem known as hallucination. We instead propose post-training an LLM to generate content only when confident in its correctness and to otherwise…

Cited by 0SourceScholar
2026

Select2Plan: Training-Free ICL-Based Planning through VQA and Memory Retrieval

ICRA 2026poster

We introduce Select2Plan (S2P), a novel training-free framework for high-level robot planning that leverages off-the-shelf Vision-Language Models (VLMs) for autonomous navigation. Unlike most learning-based approaches that require extensive task- specific training and large-scale data collection, S2…

2025

Reinforcement Learning for Quantum Control under Physical Constraints

ICML 2025poster

Quantum control is concerned with the realisation of desired dynamics in quantum systems, serving as a linchpin for advancing quantum technologies and fundamental research. Analytic approaches and standard optimisation algorithms do not yield satisfactory solutions for more complex quantum systems,…

2025

Select2Plan: Training-Free ICL-Based Planning Through VQA and Memory Retrieval

RA-L 2025

We introduce Select2Plan (S2P), a novel training-free framework for high-level robot planning that leverages off-the-shelf VLMs for autonomous navigation. Unlike most learning-based approaches that require extensive task-specific training and large-scale data collection, S2P overcomes the need for f

Cited by 4SourcecodeScholar
2025

TuCo: Measuring the Contribution of Fine-Tuning to Individual Responses of LLMs

ICML 2025poster

Past work has studied the effects of fine-tuning on large language models' (LLMs) overall performance on certain tasks. However, a way to quantitatively and systematically analyze its effect on individual outputs is still lacking. In this work, we propose a new method for measuring the contribution…

Cited by 0SourcePDFScholar
2024

HelloFresh: LLM Evalutions on Streams of Real-World Human Editorial Actions across X Community Notes and Wikipedia edits

ACL 2024findings

Benchmarks have been essential for driving progress in machine learning. A better understanding of LLM capabilities on real world tasks is vital for safe development.Designing adequate LLM benchmarks is challenging: Data from real-world tasks is hard to collect, public availability of static evaluat…

2024

Illusory Attacks: Information-theoretic detectability matters in adversarial attacks

ICLR 2024spotlight

Autonomous agents deployed in the real world need to be robust against adversarial attacks on sensory inputs. Robustifying agent policies requires anticipating the strongest attacks possible. We demonstrate that existing observation-space attacks on reinforcement learning agents have a common weakn…

Cited by 5SourcePDFScholar
2024

Select to Perfect: Imitating desired behavior from large multi-agent data

ICLR 2024poster

AI agents are commonly trained with large datasets of demonstrations of human behavior. However, not all behaviors are equally safe or desirable. Desired characteristics for an AI agent can be expressed by assigning desirability scores, which we assume are not assigned to individual behaviors but to…

Cited by 3SourcePDFScholar
2023

Extracting Reward Functions from Diffusion Models

NeurIPS 2023poster

Diffusion models have achieved remarkable results in image generation, and have similarly been used to learn high-performing policies in sequential decision-making tasks. Decision-making diffusion models can be trained on lower-quality data, and then be steered with a reward function to generate ne…

2022

Learn what matters: cross-domain imitation learning with task-relevant embeddings

NeurIPS 2022accept

We study how an autonomous agent learns to perform a task from demonstrations in a different domain, such as a different environment or different agent. Such cross-domain imitation learning is required to, for example, train an artificial agent from demonstrations of a human expert. We propose a sca…

Cited by 17SourcePDFScholar
2022

Learning Altruistic Behaviours in Reinforcement Learning without External Rewards

ICLR 2022spotlight

Can artificial agents learn to assist others in achieving their goals without knowing what those goals are? Generic reinforcement learning agents could be trained to behave altruistically towards others by rewarding them for altruistic behaviour, i.e., rewarding them for benefiting other agents in a…

Cited by 11SourcePDFScholar