Donghyeon Shin

From Generation to Selection: Findings of Converting Analogical Problem-Solving into Multiple-Choice Questions

As artificial intelligence reasoning abilities gain prominence, generating reliable benchmarks becomes crucial. The Abstract and Reasoning Corpus (ARC) offers challenging problems yet unsolved by AI. While ARC effectively assesses reasoning, its generation-based evaluation overlooks other assessment…