Shuyuan Peng

Beyond Layout Embedding: Layout Attention with Gaussian Biases for Structured Document Understanding

Effectively encoding layout information is a central problem in structured document understanding. Most existing methods rely heavily on millions of trainable parameters to learn the layout features of each word from Cartesian coordinates. However, two unresolved questions remain: (1) Is the Cartesi…