2024
Hopping Too Late: Exploring the Limitations of Large Language Models on Multi-Hop Queries
EMNLP 2024main
Large language models (LLMs) can solve complex multi-step problems, but little is known about how these computations are implemented internally. Motivated by this, we study how LLMs answer multi-hop queries such as “The spouse of the performer of Imagine is”. These queries require two information ex…