← Search

Jonathan Colaço Carr

2 accepted papers

2025

Beyond the Safety Bundle: Auditing the Helpful and Harmless Dataset

NAACL 2025long

In an effort to mitigate the harms of large language models (LLMs), learning from human feedback (LHF) has been used to steer LLMs towards outputs that are intended to be both less harmful and more helpful. Despite the widespread adoption of LHF in practice, the quality of this feedback and its effe…

2024

Conditions on Preference Relations that Guarantee the Existence of Optimal Policies

AISTATS 2024poster

Learning from Preferential Feedback (LfPF) plays an essential role in training Large Language Models, as well as certain types of interactive learning agents. However, a substantial gap exists between the theory and application of LfPF algorithms. Current results guaranteeing the existence of optima…

Cited by 3SourcePDFScholar