Ionut-Catalin Sandu

Large Sequence Representation Learning via Multi-Stage Latent Transformers

We present LANTERN, a multi-stage transformer architecture for named-entity recognition (NER) designed to operate on indefinitely large text sequences (i.e. > 512 elements). For a given image of a form with structured text, our method uses language and spatial features to predict the entity tags of…