← Search

Yuchen Mao

6 accepted papers

2026

On Path to Multimodal Historical Reasoning: HistBench and HistAgent

ICML 2026poster

Recent advances in large language models (LLMs) have led to remarkable progress across various domains, yet their capabilities in the humanities, particularly history, remain underexplored. Historical reasoning poses unique challenges for LLMs, involving multimodal source interpretation, temporal in…

Cited by 0SourcecodeScholar
2026

VideoAgentTrek: Computer-Use Pretraining from Unlabeled Videos

ICLR 2026poster

Training computer-use agents requires massive amounts of GUI interaction data, but manually annotating action trajectories at scale is prohibitively expensive. We present VideoAgentTrek, a scalable pipeline that automatically mines training data from publicly available screen-recorded videos, elimin…

Cited by 0SourcecodeScholar
2025

AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorials

ICLR 2025spotlight

Graphical User Interface (GUI) agents hold great potential for automating complex tasks across diverse digital environments, from web applications to desktop software. However, the development of such agents is hindered by the lack of high-quality, multi-step trajectory data required for effective t…

Cited by 11SourcePDFScholar
2025

Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late In Training

ICLR 2025spotlight

Sharpness-Aware Minimization (SAM) has substantially improved the generalization of neural networks under various settings. Despite the success, its effectiveness remains poorly understood. In this work, we discover an intriguing phenomenon in the training dynamics of SAM, shedding light on understa…

Cited by 0SourcePDFScholar
2024

Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?

NeurIPS 2024spotlight

Data science and engineering workflows often span multiple stages, from warehousing to orchestration, using tools like BigQuery, dbt, and Airbyte. As vision language models (VLMs) advance in multimodal understanding and code generation, VLM-based agents could potentially automate these workflows by…