Xiyang Liao

PIXAR: Auto-Regressive Language Modeling in Pixel Space

Recent work showed the possibility of building open-vocabulary large language models (LLMs) that directly operate on pixel representations. These models are implemented as autoencoders that reconstruct masked patches of rendered text.However, these pixel-based LLMs are limited to discriminative task…