Yu-Chung Hsiao — accepted AI-conference papers

2025

ScreenQA: Large-Scale Question-Answer Pairs Over Mobile App Screenshots

Yu-Chung Hsiao, Fedir Zubach, Gilles Baechler, Srinivas Sunkara, Victor Carbune, Jason Lin +3

NAACL 2025long

We introduce ScreenQA, a novel benchmarking dataset designed to advance screen content understanding through question answering. The existing screen datasets are focused either on low-level structural and component understanding, or on a much higher-level composite task such as navigation and task c…

Cited by 34 Source ↗PDF ↗code ↗Scholar ↗

2022

Towards Better Semantic Understanding of Mobile Interfaces

Srinivas Sunkara, Maria Wang, Lijuan Liu, Gilles Baechler, Yu-Chung Hsiao, Jindong Chen +2

COLING 2022main

Improving the accessibility and automation capabilities of mobile devices can have a significant positive impact on the daily lives of countless users. To stimulate research in this direction, we release a human-annotated dataset with approximately 500k unique annotations aimed at increasing the und…

Cited by 31 Source ↗PDF ↗code ↗Scholar ↗