Mehrdad Farahani

Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models

Generative language models often struggle with specialized or less-discussed knowledge. A potential solution is found in Retrieval-Augmented Generation (RAG) models which act like retrieving information before generating responses. In this study, we explore how the Atlas approach, a RAG model, decid…