Jonathan R. Brennan

Decoding Probing: Revealing Internal Linguistic Structures in Neural Language Models Using Minimal Pairs

Inspired by cognitive neuroscience studies, we introduce a novel “decoding probing” method that uses minimal pairs benchmark (BLiMP) to probe internal linguistic characteristics in neural language models layer by layer. By treating the language model as the brain and its representations as “neural a…