← Search

Florian Buettner

18 accepted papers

2026

Fine-grained Uncertainty Decomposition in Large Language Models: A Spectral Approach

AAAI 2026technical

As Large Language Models (LLMs) are increasingly integrated in diverse applications, obtaining reliable measures of their predictive uncertainty has become critically important. A precise distinction between aleatoric uncertainty, arising from inherent ambiguities within input data, and epistemic un

Cited by 0SourcePDFScholar
2025

Efficient Unsupervised Shortcut Learning Detection and Mitigation in Transformers

ICCV 2025poster

Shortcut learning, i.e., a model's reliance on undesired features not directly relevant to the task, is a major challenge that severely limits the applications of machine learning algorithms, particularly when deploying them to assist in making sensitive decisions, such as in medical diagnostics. In…

2025

Federated Continual Learning Goes Online: Uncertainty-Aware Memory Management for Vision Tasks and Beyond

ICLR 2025poster

Given the ability to model more realistic and dynamic problems, Federated Continual Learning (FCL) has been increasingly investigated recently. A well-known problem encountered in this setting is the so-called catastrophic forgetting, for which the learning model is inclined to focus on more recent…

Cited by 0SourcePDFScholar
2025

Improving Perturbation-based Explanations by Understanding the Role of Uncertainty Calibration

NeurIPS 2025spotlight

Perturbation-based explanations are widely utilized to enhance the transparency of machine-learning models in practice. However, their reliability is often compromised by the unknown model behavior under the specific perturbations used. This paper investigates the relationship between uncertainty ca…

Cited by 0SourceScholar
2025

Incremental Uncertainty-aware Performance Monitoring with Active Labeling Intervention

AISTATS 2025poster

We study the problem of monitoring machine learning models under gradual distribution shifts, where circumstances change slowly over time, often leading to unnoticed yet significant declines in accuracy. To address this, we propose Incremental Uncertainty-aware Performance Monitoring (IUPM), a novel…

Cited by 0SourcecodeScholar
2024

A Bias-Variance-Covariance Decomposition of Kernel Scores for Generative Models

ICML 2024poster

Generative models, like large language models, are becoming increasingly relevant in our daily lives, yet a theoretical framework to assess their generalization behavior and uncertainty does not exist. Particularly, the problem of uncertainty estimation is commonly solved in an ad-hoc and task-depen…

2024

Consistent and Asymptotically Unbiased Estimation of Proper Calibration Errors

AISTATS 2024poster

Proper scoring rules evaluate the quality of probabilistic predictions, playing an essential role in the pursuit of accurate and well-calibrated models. Every proper score decomposes into two fundamental components – proper calibration error and refinement – utilizing a Bregman divergence. While unc…

Cited by 6SourcePDFScholar
2024

Provably Better Explanations with Optimized Aggregation of Feature Attributions

ICML 2024poster

Using feature attributions for post-hoc explanations is a common practice to understand and verify the predictions of opaque machine learning models. Despite the numerous techniques available, individual methods often produce inconsistent and unstable results, putting their overall reliability into…

Cited by 3SourcePDFScholar
2023

Encoding Domain Knowledge in Multi-view Latent Variable Models: A Bayesian Approach with Structured Sparsity

AISTATS 2023poster

Many real-world systems are described not only by data from a single source but via multiple data views. In genomic medicine, for instance, patients can be characterized by data from different molecular layers. Latent variable models with structured sparsity are a commonly used tool for disentanglin…

2023

Test Time Augmentation Meets Post-hoc Calibration: Uncertainty Quantification under Real-World Conditions

AAAI 2023technical

Communicating the predictive uncertainty of deep neural networks transparently and reliably is important in many safety-critical applications such as medicine. However, modern neural networks tend to be poorly calibrated, resulting in wrong predictions made with a high confidence. While existing pos…

2023

Uncertainty Estimates of Predictions via a General Bias-Variance Decomposition

AISTATS 2023poster

Reliably estimating the uncertainty of a prediction throughout the model lifecycle is crucial in many safety-critical applications. The most common way to measure this uncertainty is via the predicted confidence. While this tends to work well for in-domain samples, these estimates are unreliable und…

2022

Better Uncertainty Calibration via Proper Scores for Classification and Beyond

NeurIPS 2022accept

With model trustworthiness being crucial for sensitive real-world applications, practitioners are putting more and more focus on improving the uncertainty calibration of deep neural networks. Calibration errors are designed to quantify the reliability of probabilistic predictions but their estimator…

Cited by 53SourcePDFScholar
2022

Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibration

ECCV 2022poster

"We address the problem of uncertainty calibration and introduce a novel calibration method, Parametrized Temperature Scaling (PTS). Standard deep neural networks typically yield uncalibrated predictions, which can be transformed into calibrated confidence scores using post-hoc calibration methods.…

2021

Post-Hoc Uncertainty Calibration for Domain Drift Scenarios

CVPR 2021poster

We address the problem of uncertainty calibration. While standard deep neural networks typically yield uncalibrated predictions, calibrated confidence scores that are representative of the true likelihood of a prediction can be achieved using post-hoc calibration methods. However, to date, the focus…

Cited by 89PDFcodeScholar
2021

Towards Trustworthy Predictions from Deep Neural Networks with Fast Adversarial Calibration

AAAI 2021technical

To facilitate a wide-spread acceptance of AI systems guiding decision making in real-world applications, trustworthiness of deployed models is key. That is, it is crucial for predictive models to be uncertainty-aware and yield well-calibrated (and thus trustworthy) predictions for both in-domain sam…

2019

textTOvec: DEEP CONTEXTUALIZED NEURAL AUTOREGRESSIVE TOPIC MODELS OF LANGUAGE WITH DISTRIBUTED COMPOSITIONAL PRIOR

ICLR 2019poster

We address two challenges of probabilistic topic modelling in order to better estimate the probability of a word in a given context, i.e., P(wordjcontext) : (1) No Language Structure in Context: Probabilistic topic models ignore word order by summarizing a given context as a “bag-of-word” and conseq…