← Search

Koyena Pal

2 accepted papers

2025

Internal states before wait modulate reasoning patterns

EMNLP 2025

Prior work has shown that a significant driver of performance in reasoning models is their ability to reason and self-correct. A distinctive marker in these reasoning traces is the token wait , which often signals reasoning behavior such as backtracking. Despite being such a complex behavior, little

Cited by 0SourcePDFScholar
2025

NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internals

ICLR 2025poster

We introduce NNsight and NDIF, technologies that work in tandem to enable scientific study of the representations and computations learned by very large neural networks. NNsight is an open-source system that extends PyTorch to introduce deferred remote execution. The National Deep Inference Fabric (…