← Search

Anisha Mascarenhas

2 accepted papers

2023

Evaluating the Factual Consistency of Large Language Models Through News Summarization

ACL 2023findings

While large language models (LLMs) have proven to be effective on a large variety of tasks, they are also known to hallucinate information. To measure whether an LLM prefers factually consistent continuations of its input, we propose a new benchmark called FIB (Factual Inconsistency Benchmark) that…

2023

Git-Theta: A Git Extension for Collaborative Development of Machine Learning Models

ICML 2023poster

Currently, most machine learning models are trained by centralized teams and are rarely updated. In contrast, open-source software development involves the iterative development of a shared artifact through distributed collaboration using a version control system. In the interest of enabling collabo…