Colin Daniels

The Geometry and Topology of Circuits: the Manifolds of Modular Addition

The Clock and Pizza interpretations, associated with architectures differing in either uniform or learnable attention, were introduced to argue that different architectural designs can yield distinct circuits for modular addition. In this work, we show that this is not the case, and that both the un…