Temporal Sparse Autoencoders: Leveraging the Sequential Nature of Language for Interpretability
Translating the internal representations and computations of models into concepts that humans can understand is a key goal of interpretability. While recent dictionary learning methods such as Sparse Autoencoders (SAEs) provide a promising route to discover human-interpretable features, they often o…