2023
StrucTexTv2: Masked Visual-Textual Prediction for Document Image Pre-training
ICLR 2023poster
In this paper, we present StrucTexTv2, an effective document image pre-training framework, by performing masked visual-textual prediction. It consists of two self-supervised pre-training tasks: masked image modeling and masked language modeling, based on text region-level image masking. The proposed…