← Search

Dylan Z Slack

5 accepted papers

2024

A Careful Examination of Large Language Model Performance on Grade School Arithmetic

NeurIPS 2024spotlight

Large language models (LLMs) have achieved impressive success on many benchmarks for mathematical reasoning. However, there is growing concern that some of this performance actually reflects dataset contamination, where data closely resembling benchmark questions leaks into the training data, instea…

Cited by 77SourcePDFScholar
2024

Learning Goal-Conditioned Representations for Language Reward Models

NeurIPS 2024poster

Techniques that learn improved representations via offline data or self-supervised objectives have shown impressive results in traditional reinforcement learning. Nevertheless, it is unclear how improved representation learning can benefit reinforcement learning from human feedback on language model…

2023

Post Hoc Explanations of Language Models Can Improve Language Models

NeurIPS 2023poster

Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex tasks. Moreover, recent research has shown that incorporating human-annotated rationales (e.g., Chain-of-Thought prompting) during in-context learning can significantly enhance the performance of these model…

Cited by 72SourcePDFScholar
2021

Counterfactual Explanations Can Be Manipulated

NeurIPS 2021poster

Counterfactual explanations are emerging as an attractive option for providing recourse to individuals adversely impacted by algorithmic decisions. As they are deployed in critical applications (e.g. law enforcement, financial lending), it becomes important to ensure that we clearly understand the…

Cited by 174SourcePDFScholar
2021

Reliable Post hoc Explanations: Modeling Uncertainty in Explainability

NeurIPS 2021poster

As black box explanations are increasingly being employed to establish model credibility in high stakes settings, it is important to ensure that these explanations are accurate and reliable. However, prior work demonstrates that explanations generated by state-of-the-art techniques are inconsistent,…

Cited by 218SourcePDFScholar