← Search

Freddie Bickford Smith

6 accepted papers

2026

BED-LLM: Intelligent Information Gathering with LLMs and Bayesian Experimental Design

ICLR 2026poster

We propose a general-purpose approach for improving the ability of large language models (LLMs) to intelligently and adaptively gather information from a user or other external source using the framework of sequential Bayesian experimental design (BED). This enables LLMs to act as effective multi-tu…

Cited by 0SourceScholar
2025

Rethinking Aleatoric and Epistemic Uncertainty

ICML 2025poster

The ideas of aleatoric and epistemic uncertainty are widely used to reason about the probabilistic predictions of machine-learning models. We identify incoherence in existing discussions of these ideas and suggest this stems from the aleatoric-epistemic view being insufficiently expressive to captur…

Cited by 2SourcePDFScholar
2025

Scaling Up Active Testing to Large Language Models

NeurIPS 2025poster

Active testing enables label-efficient evaluation of predictive models through careful data acquisition, but it can pose a significant computational cost. We identify cost-saving measures that enable active testing to be scaled up to large language models (LLMs). In particular we show that the surro…

Cited by 0SourceScholar
2024

Making Better Use of Unlabelled Data in Bayesian Active Learning

AISTATS 2024poster

Fully supervised models are predominant in Bayesian active learning. We argue that their neglect of the information present in unlabelled data harms not just predictive performance but also decisions about what data to acquire. Our proposed solution is a simple framework for semi-supervised Bayesian…

2023

Prediction-Oriented Bayesian Active Learning

AISTATS 2023poster

Information-theoretic approaches to active learning have traditionally focused on maximising the information gathered about the model parameters, most commonly by optimising the BALD score. We highlight that this can be suboptimal from the perspective of predictive performance. For example, BALD lac…

2022

Continual Learning via Sequential Function-Space Variational Inference

ICML 2022spotlight

Sequential Bayesian inference over predictive functions is a natural framework for continual learning from streams of data. However, applying it to neural networks has proved challenging in practice. Addressing the drawbacks of existing techniques, we propose an optimization objective derived by for…