← Search

Jason Lin

2 accepted papers

2025

ScreenQA: Large-Scale Question-Answer Pairs Over Mobile App Screenshots

NAACL 2025long

We introduce ScreenQA, a novel benchmarking dataset designed to advance screen content understanding through question answering. The existing screen datasets are focused either on low-level structural and component understanding, or on a much higher-level composite task such as navigation and task c…

2024

ScreenAI: A Vision-Language Model for UI and Infographics Understanding

IJCAI 2024poster

Screen user interfaces (UIs) and infographics, sharing similar visual language and design principles, play important roles in human communication and human-machine interaction. We introduce ScreenAI, a vision-language model that specializes in UI and infographics understanding. Our model improves…